
Data Engineer - AI & Analytics
Southwest Airlines · Posted 1 month ago
- Greater Hyderabad Area (On-site)
- On-site
- Full-time
- 2-5 yrs
About the role
Department
Technology
Our Company Promise
We are committed to provide our Employees a stable work environment with equal opportunity for learning and personal growth. Creativity and innovation are encouraged for improving the effectiveness of Southwest Airlines. Above all, Employees will be provided the same concern, respect, and caring attitude within the organization that they are expected to share externally with every Southwest Customer.
Job Description
Job Summary
- Work with limited supervision to support data engineering and data analytics solutions. Provide design guidance and implementation for end-to-end analytic solutions. Coordinate with SWA focused groups to create unique data infrastructure, run tests on their designs to isolate errors and update systems to accommodate changes in company needs
Responsibilities
- Assemble large, complex sets of data that meet non-functional and functional business requirements
- Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
- Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
- Work with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
- Work with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
- Generate or adapt equipment and technology to serve user needs
- May perform other job duties as directed by Employee's Leaders
- Advanced SQL development, data modelling, performance tuning, and enterprise-scale analytical datasets.
- Advanced Python development for reusable data frameworks, automation, testing, and production-grade engineering
- Design and ownership of scalable ETL/ELT architectures, data lake, lakehouse, and enterprise integration patterns.
- Advanced AWS data engineering experience across Glue, S3, Athena, Redshift, EMR, Kinesis, Step Functions, Airflow/MWAA, security, and reliability.
- Data quality, governance, APIs, CI/CD pipelines, observability, automated testing, and production support leadership
- Lead scalable enterprise data engineering foundations supporting Agent Observability, Ops Enablement, and future autonomous operations.
- Own telemetry ingestion, data processing pipelines, evaluation datasets, and reusable data engineering frameworks on AWS.
- Serve as the technical partner across Product, AI, Operations, and Engineering teams while improving platform reliability, governance, and scalability.
- Knowledge, Skills And Abilities
- Knowledge of the practical application of engineering science and technology, including applying principles, techniques, procedures, and equipment to the design and production of various goods and services
- Knowledge of design techniques, tools, and principles involved in production of precision technical plans, blueprints, drawings, and models
- Ability to use logic and reasoning to identify the strengths and weaknesses of alternative solutions, conclusions or approaches to problems
- Ability to understand new information for both current and future problem-solving and decision-making
- Skilled in identifying complex problems and reviewing related information to develop and evaluate options and implement solutions
- Ability to recognize when an issue has occurred or is likely to occur, without needing to diagnose or resolve the problem.
- Ability to combine pieces of information to form general rules or conclusions (includes finding a relationship among seemingly unrelated events)
- Ability to switch efficiently between multiple tasks or information sources, such as spoken instructions, system alerts, or data inputs.
- Ability to organize data or actions in a defined sequence or structure based on specified rules or patterns (e.g., numerical, textual, visual, or mathematical sequences).
- Ability to recognize defined patterns—such as shapes, words, or signals—even when they are embedded within distracting or complex information.
- Advanced SQL development, data modelling, performance tuning, and enterprise-scale analytical datasets.
- Advanced Python development for reusable data frameworks, automation, testing, and production-grade engineering
- Design and ownership of scalable ETL/ELT architectures, data lake, lakehouse, and enterprise integration patterns.
- Advanced AWS data engineering experience across Glue, S3, Athena, Redshift, EMR, Kinesis, Step Functions, Airflow/MWAA, security, and reliability.
- Data quality, governance, APIs, CI/CD pipelines, observability, automated testing, and production support leadership
- Databricks and Apache Spark
- Iceberg, Delta Lake, and Hudi
- Kafka, Kinesis, and streaming architectures
- AI/GenAI telemetry, vector databases, RAG analytics, QuickSight, or Grafana
Education
- Required: Bachelor's degree in Computer Science, Engineering, Information Systems or related field and/or equivalent formal training
Experience
- Required: Intermediate level experience, fully functioning broad knowledge in:
- Cloud infrastructure, DataLake
- ETL experience ensuring source to target data integrity
- Various filetypes (Delimited Text, Fixed Width, XML, JSON, Parque).
- ServiceBus, setting up ingress and egress within a subscription, or relevant AWS Cloud services administrative experience.
- Unit Testing, Code Quality tools, CI/CD Technologies, Security and Container Technologies
- Agile development experience and Agile ceremonies and practices
- 2-5 years of relevant work-related experience
- Advanced SQL development, data modelling, performance tuning, and enterprise-scale analytical datasets.
- Advanced Python development for reusable data frameworks, automation, testing, and production-grade engineering
- Design and ownership of scalable ETL/ELT architectures, data lake, lakehouse, and enterprise integration patterns.
- Advanced AWS data engineering experience across Glue, S3, Athena, Redshift, EMR, Kinesis, Step Functions, Airflow/MWAA, security, and reliability.
- Data quality, governance, APIs, CI/CD pipelines, observability, automated testing, and production support leadership
- Preferred Experience
- Databricks and Apache Spark
- Iceberg, Delta Lake, and Hudi
- Kafka, Kinesis, and streaming architectures
- AI/GenAI telemetry, vector databases, RAG analytics, QuickSight, or Grafana
- Other Qualifications
- Must meet confidentiality expectations as to confidential, proprietary and sensitive Company information
- Ability to work extended hours as needed
- Ability to work onsite approximately 3 days per week and as required by the business.
- Southwest Airlines is an Equal Opportunity Employer.
- Please print/save this job description because it won't be available after you apply.
- Job Posting End Date
- 09/29/2026
Skills
Quark9 guide
How to land this Data Engineer - AI & Analytics role
Our notes for applicants, based on how data and AI hiring usually works and on 915 similar open jobs on Quark9.
Resume checklist for this job
Most companies screen resumes with an ATS before a person reads them. Make sure each skill you genuinely have appears in your resume in the same words the job uses.
Must have
- Advanced SQL development
- Data modelling
- Performance tuning
- Enterprise-scale analytical datasets
- Advanced Python development for reusable data frameworks, automation, testing, production-grade engineering
- Design and ownership of scalable ETL/ELT architectures, data lake, lakehouse, enterprise integration patterns
- Advanced AWS data engineering experience across Glue, S3, Athena, Redshift, EMR, Kinesis, Step Functions, Airflow/MWAA, security, reliability
- Data quality, governance, APIs, CI/CD pipelines, observability, automated testing, production support leadership
- Lead each project with the business result (revenue, cost, time saved), then the method
- List the stack precisely: SQL dialect, Python libraries, BI tool, cloud platform
- Link a portfolio or GitHub with one or two well-documented projects
What interviewers expect: early to mid level
Expect questions about work you owned end to end. Show what you delivered, the tools you used daily and one or two results with numbers.
How data and AI interviews usually run
- A screening call on your projects and the size of data you have worked with
- A SQL round, usually joins, window functions and aggregations on a sample schema
- A case or modelling round: frame a business problem, choose metrics, explain trade-offs
- A take-home or live exercise in Python, then a final round with the hiring manager
Questions worth preparing
- Write a query for the second-highest salary in each department.
- How would you measure whether a new feature improved retention?
- Explain overfitting to a non-technical stakeholder and how you guard against it.
- Walk through a project end to end: the question, the data, the method and the impact.
Every company runs its own process, so treat this as a likely shape, not a promise. Practise a mock interview on Quark9 and get scored feedback before the real one.
The market for Data Engineer roles right now
- Most openings are in Hyderabad, Bengaluru, Bengaluru East, Navi Mumbai, and 4 of the 19 we looked at offer remote work.
- The skills these jobs ask for most:
From open jobs on Quark9 matching “Data Engineer”, updated every few minutes.
Similar jobs
- Software Engineer, Security, Privacy, DetectionGoogle · Hyderabad, Telangana, India (On-site)
- Back End DeveloperTalemexa · India (Remote)
- Software Development Engineer -BackendRenesas Electronics · Bengaluru East, Karnataka, India (Remote)
- Back End Developer InternJobs4PanIndia · India (Remote)
- Software Engineer (Junior Role)Zema Global Data Corporation · Navi Mumbai, Maharashtra, India (Hybrid)