×
Justin Smith

Justin Smith

Senior Backend Engineer

Starkville, Mississippi, US, 39759
662.312.6864
English

Background


About

About

Senior Backend Engineer focused on high-ROI infrastructure and backend systems. Leverages deep expertise in Python and Distributed Systems to build platforms that scale revenue and efficiency. Achievements include founding a company's first Data Science unit to establish new recurring revenue streams and engineering solutions that secured $8M in contracts.

Work Experience

Work Experience

  • Software Engineer, Estuary

    Feb, 2025 - Present

    Building high-performance data connectors and infrastructure for real-time data capture at scale.

    • Architected a subtask state management solution to unlock data capture for 6,500 Stripe Connected Accounts, enabling parallel processing of 500,000+ concurrent streams with zero data loss.

    • Orchestrated a zero-downtime online migration for 20+ enterprise clients by re-architecting a legacy Airbyte wrapper into a native Async Python connector, unlocking 17 resource types and preserving 100% of historical data.

    • Slashed recovery log storage costs by 80% by engineering a precise JSON merge patch checkpointing system, eliminating redundant data capture and unnecessary recovery log growth.

    • Fortified API security by implementing robust JWT refresh and OAuth strategies, achieving 100% compliance with strict enterprise security standards for high-profile clients.

    • Scaled connector throughput to handle gigabytes of data/minute by implementing asynchronous patterns, reducing data lag for downstream enterprise analytics.

    • Championed the investigation and resolution of critical data gaps across 10+ self-authored connectors, diagnosing complex edge cases in production to successfully recover 100% of missing records.

    • Refactored and migrated Shopify connector by migrating to GraphQL, adding 7+ new data streams and bulk operations, improving data access for 30+ users within 3 months.

  • Senior Data EngineerCamgian

    Jul, 2023 - Feb, 20251 year 6 months

    Lead strategic technical initiatives focused on scaling data platforms and optimizing system performance.

    • Secured $8M in follow-on contracts and drove critical business expansion by architecting high-performance, edge-based data microservices using Docker and Python.

    • Increased Kafka throughput by 300% within 3 months by optimizing broker configurations in a self-managed KRaft cluster, enhancing real-time data processing capabilities.

    • Reduced monthly AWS costs by 40% by optimizing EC2 compute needs through detailed instrumentation and monitoring with Prometheus and Grafana.

    • Maintained 100% system availability during the global 2024 CrowdStrike outage by architecting a fault-tolerant Kafka platform (C#, Python), ensuring uninterrupted processing for mission-critical workflows.

    • Designed and built a fault-tolerant real-time data platform from the ground up using Kafka Streams and Kafka Connect, cutting data ingestion latency from 24 hours to minutes while eliminating manual intervention.

    • Reduced latency by 50% by optimizing Python ETL pipelines, enhancing data processing for 15M+ records daily from AWS S3.

    • Designed solutions that reduced storage costs by 70% by leveraging TimescaleDB tiered storage strategies backed by AWS S3 and S3 Glacier, enhancing compliance and data accessibility for 60K+ tables.

  • Software EngineerCamgian

    Jun, 2021 - Jul, 20232 years 2 months

    Developed modern web applications and established the company's first Data Science unit.

    • Eliminated a wide class of runtime errors by re-platforming legacy web apps to a type-safe Next.js/tRPC stack, accelerating feature delivery by 50%.

    • Slashed code duplication by 30% and standardized build configurations by consolidating distributed TypeScript projects into a high-performance Turborepo monorepo.

    • Founded the company's first Data Science unit by engineering a Cognitive Computing product that secured multi-million dollar contracts and established a new recurring revenue stream.

    • Strengthened security posture for enterprise clients by integrating Okta SSO and MFA, streamlining access management for 25 users.

Skills

Skills

  • Programming Languages

    Python

    TypeScript

    JavaScript

    SQL

    Go

  • Frameworks & Libraries

    Asyncio

    FastAPI

    Pydantic

    Next.js

    React

    tRPC

    Zod

  • Data Engineering & Analysis

    Kafka

    AVRO

    Kafka Connect

    Schema Registry

    Kafka Streams

    PostgreSQL

    TimescaleDB

    InfluxDB

  • DevOps & Infrastructure

    AWS (EC2, ECR, S3)

    Docker

    Terraform

    GitHub Actions

    GitLab

    GitHub

    Jenkins

    Linux

  • Tools & Technologies

    OIDC

    REST

    GraphQL

    RabbitMQ

Education

Education

  • Software Engineering, Bachelor of Science (BS), Mississippi State University

    Aug, 2019 - May, 2021

Awards

Awards

  • Phi Theta Kappa International Honor Society

    Awarded on: Aug 31, 2019

    Inducted as a member of Phi Theta Kappa Honor Society.

  • Cum Laude

    Awarded on: May 31, 2021

    Graduated with a 3.68 GPA from Mississippi State University.

Interests

Interests

  • Disc Golf

    Casual League PlayCompetitive Tournaments
  • Fishing

    Bass Fishing
  • Springer Spaniel

    Training
  • Home Improvement

    DIY ProjectsLandscapingPainting
References

References

  • Alexander Hines

    Justin's adaptability and quick uptake of new tools and technologies played a critical role in our team's success. He identified Apache Kafka as the most suitable data engineering tool for extracting, replicating, and transforming data from proprietary systems. His design and implementation of the backend integrated data platform has been a stable and reliable solution for our clients, laying a solid foundation for the future of Data Engineering at Camgian.

  • Camgian - Internal Recognition

    When our client's servers went down during the CrowdStrike outage, and we stopped receiving live data, Justin was quick to identify the root cause, reach out to the customer to confirm, and was quick to resolve the issue once the client's servers were back online. Justin set and met the goal of monitoring and responding to any issues with the production system, didn't tolerate any problems once an issue arose, quickly diagnosed the root cause, identified an effective solution, and pushed through to completion, ensuring that the product displayed accurate and up-to-date information. This award symbolizes excellence at Camgian and exemplify the drive, determination, and dedication to achieving elite performer status per our Principles.