I'm Krishna Khadka, a data engineer focused on building reliable systems and thoughtful data products. My work spans data pipelines, analytics engineering, and practical automation. I enjoy solving real problems with simple, maintainable solutions.
Work Experience
Arctic Wolf
Senior Data Engineer Current
Bengaluru, Karnataka, India · Hybrid
- Build data engineering solutions on a petabyte-scale data lake on Databricks/AWS.
- Design scalable pipelines to reliably process terabytes of security observations daily, ensuring high throughput and low latency.
- Optimize SQL and Spark queries for efficient data retrieval, reducing compute costs and improving query performance across large datasets.
- Drive performance tuning, monitoring, and cost optimization of Databricks jobs and Delta tables.
- Enhance data reliability with schema validation, error handling, and automated quality checks across ingestion workflows.
- Maintain robust data governance and RBAC-based access controls, ensuring secure handling of sensitive cybersecurity datasets.
OutSystems
Senior Data Engineer
Bengaluru, Karnataka, India · Hybrid
- Designed data architecture on AWS for data storage, processing, and analysis.
- Developed and deployed data pipelines and models for ETL using Apache Spark and Kafka.
- Implemented scalable data processing solutions using Apache Spark on Databricks, including Delta tables, jobs, workflows, dashboards, and alerts.
- Leveraged advanced SQL querying and optimization strategies to extract insights from large datasets on Databricks and Snowflake.
- Built data reporting and analytics capabilities using OpenSearch.
- Monitored and optimized the Kubernetes environment, and managed infrastructure as code using Terraform.
- Integrated a schema registry for efficient management and governance of telemetry data.
- Designed and implemented data lineage solutions to track data flow and transformations across the pipeline.
- Designed and implemented distributed systems to ensure scalability, reliability, and high availability.
OpenText
Senior Software Engineer
Bengaluru, Karnataka, India · On-site
- Designed and developed secure REST APIs for seamless integration between multiple systems, incorporating robust authentication and authorization mechanisms like OAuth and JWT.
- Orchestrated the successful migration of on-premises products to the cloud, leveraging cloud deployment technologies to optimize scalability, availability, and performance.
- Implemented Infrastructure as Code (IaC) using Terraform to automate the setup of cloud resources for SaaS products.
- Led development of a password management service as a SaaS product, ensuring robust security and a seamless user experience.
OpenText (formerly MicroFocus)
Software Engineer
Bengaluru, Karnataka, India
- Developed an analytics dashboard for Access Manager focused on logs analytics and management, using Elasticsearch, Logstash, Kibana, Apache Kafka, and Apache Spark.
- Utilized Docker and Kubernetes to design and implement microservices for a containerized product.
- Streamlined product upgrades by implementing an Upgrade Assistant and channel upgrade feature, enabling one-click upgrades.
OpenText (formerly MicroFocus)
Software Engineer Intern
Greater Bengaluru Area
- Designed and implemented a DNS certificate issuing client using the ACME protocol, integrated seamlessly into the product.
- Gained extensive knowledge of technologies including SAML, single sign-on, OAuth, and LDAP.
- Implemented secure coding practices to mitigate cross-site scripting (XSS) attacks and other malicious content injection.
Certifications
Certified Kubernetes Application Developer
Kubernetes (Official)
Issued Apr 2026
Databricks Certified Generative AI Engineer Associate
Databricks
Issued Jan 2026
Databricks Certified Data Analyst Associate
Databricks
Issued Oct 2025 · Expires Oct 2027
Databricks Certified Associate Developer for Apache Spark
Databricks
Issued Aug 2025
Databricks Certified Data Engineer Professional
Databricks
Issued Nov 2024 · Expires Nov 2026
AWS Certified Solutions Architect Associate
Amazon Web Services (AWS)
Issued Apr 2024
HashiCorp Certified: Terraform Associate (003)
ExpiredHashiCorp
Issued Jun 2023 · Expired Jul 2025
AWS Certified Cloud Practitioner
Amazon Web Services (AWS)
Issued May 2023
PCAP – Certified Associate in Python Programming
Python Institute
Issued Jan 2022
Certified Kubernetes Application Developer
Kubernetes (Official)
Issued Apr 2026
Databricks Certified Generative AI Engineer Associate
Databricks
Issued Jan 2026
Databricks Certified Data Analyst Associate
Databricks
Issued Oct 2025 · Expires Oct 2027
Databricks Certified Associate Developer for Apache Spark
Databricks
Issued Aug 2025
Databricks Certified Data Engineer Professional
Databricks
Issued Nov 2024 · Expires Nov 2026
AWS Certified Solutions Architect Associate
Amazon Web Services (AWS)
Issued Apr 2024
HashiCorp Certified: Terraform Associate (003)
ExpiredHashiCorp
Issued Jun 2023 · Expired Jul 2025
AWS Certified Cloud Practitioner
Amazon Web Services (AWS)
Issued May 2023
PCAP – Certified Associate in Python Programming
Python Institute
Issued Jan 2022