Skip to content
Michael Hackett edited this page May 3, 2023 · 13 revisions

Amazon Athena Query Federation

The Amazon Athena Query Federation SDK allows you to customize Amazon Athena with your own code. This enables you to integrate with new data sources, proprietary data formats, or build in new user defined functions. Initially these customizations will be limited to the parts of a query that occur during a TableScan operation but will eventually be expanded to include other parts of the query execution plan using the same easy to understand interface.

We've written integrations with more than 20 databases, storage formats, and live APIs in order to refine this interface and balance flexibility with ease of use. We hope that making this SDK and initial set of connectors Open Source will allow us to continue to improve the experience and performance of Athena Query Federation.

Useful Pages

  1. AWS Docs: Athena Query Federation
  2. AWS Docs: Athena UDFs
  3. Quick Start Guide
  4. Available Connectors
  5. Federation Features
  6. How To Build A Connector or UDF
  7. Deploy a Connector without Serverless Application Repository
  8. Gathering diagnostic info for support
  9. Frequently Asked Questions
  10. Common Problems
  11. Installation Pre-requisites
  12. Known Limitations & Open Issues
  13. Predicate Pushdown How-To
  14. Java Doc

Helpful Videos

  1. Intro Video
  2. Workshop Video - TBD
  3. DocumentDB Video - TBD
  4. Athena Talk Video - TBD
  5. Analytics Talk Video - TBD

We Are Hiring!

One of our goals in making this project Open Source was to empower our customers to customize/extend/contribute. If you'd like the opportunity to contribute even more, we have openings for Software Engineers, Managers, and Solutions Architects in Seattle and NYC. Here are just a few of available opportunities to work with our team and shape this and other projects.