Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve support for streaming #326

Merged
merged 179 commits into from
Aug 12, 2024
Merged

Improve support for streaming #326

merged 179 commits into from
Aug 12, 2024

Conversation

imranq2
Copy link
Collaborator

@imranq2 imranq2 commented Aug 5, 2024

  1. Adds try/catch around panda udfs and ensure that they return the expected fields even if there is an exception
  2. updated to latest helix.fhir.client.sdk package
  3. Moved address-standardization from helix.pipelines to here so we can more easily test in databricks
  4. Return error text from ElasticSearchSender v2 to make troubleshooting easier
  5. Switch from OpenSearch to AsyncOpenSearch in ElasticSearchSender v2 to use async methods
  6. Add tests for streaming in FhirReceiver and FHirSender
  7. Add test to simulate a merge error from FHIR server to ensure the code handles that gracefully
  8. Fix deserialization of FhirMergeResponseItem
  9. Added a CensusStandardizingVendor that uses the Census API to get geolocation
  10. Added async methods for fhir so we can increase throughput
  11. Refactor the address standardization to v2 so we use abtract methods and pydantic classes for responses to have better error checking and type safety instead of using dicts
  12. Add a v2 of FrameworkPractitioner that automatically calculates the size of most efficient partitions and then partitions the dataframe to those.

@imranq2 imranq2 merged commit 9e7df50 into master Aug 12, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants