Datamine Network Resolves Event Stream Connection Issues
💡 AI Article Summary
Resolving Real-Time Event Stream Timeouts
During final preparations for the upcoming Alpha launch, the Datamine Network development team identified and resolved a connection issue affecting real-time event streams. The team observed that event streams were dropping after approximately 100 seconds of idle time. Because the ecosystem relies on real-time analytics, maintaining persistent connections is vital.
Bypassing Cloudflare Proxy for Security and Stability
Investigation revealed that the issue stemmed from Cloudflare’s DNS proxy routing, which converted requests to HTTP 2.0 and terminated streams after the 100-second threshold. To fix this, the team obtained a new SSL certificate and disabled Cloudflare’s DNS routing, establishing a persistent, direct server connection.
This change provides an additional security benefit: traffic for pro analytics is no longer routed through Cloudflare, adding another layer of privacy to the decentralized network. The team is now using the weekend to perform final polish and optimizations ahead of sending out the first Alpha invites.
Hey guys,
Apparently SSL configuration was not completed yesterday. Today I noticed that our Event streams are dropped after ~100 seconds of idle time.
As our analytics are done in realtime these 100 second timeouts were not going to fly. I did a lot of digging round with nchan and nginx configurations trying out various timeouts and configurations.
Turns out the problem was with cloudflare DNS routing for SSL. We were using Cloudflare DNS proxy which made requests HTTP 2.0 and since they are routed through Cloudflare they terminated the streams after this idle time.
Had to get a new certificate and turn off Cloudflare DNS routing but now the connection to the server is persistent. Another advantage of this is that traffic is not routed through cloudflare anymore on pro analytics for another layer of security. 👌
I'll take this extra long weekend time to do some polish before Alpha invites. We're looking really good now, hope to see you guys on alpha soon! 🔥
Frequently Asked Questions
Why were the Datamine Network event streams dropping?
Real-time event streams were terminating after 100 seconds of idle time because Cloudflare's DNS proxy routing was automatically closing the HTTP 2.0 connections.
How did the developers resolve the connection timeout issue?
The developers obtained a new SSL certificate and disabled Cloudflare DNS proxy routing, allowing direct and persistent connections to the server.
What is the security advantage of bypassing Cloudflare routing?
By bypassing Cloudflare, traffic for pro analytics is no longer routed through a third-party proxy, adding an extra layer of privacy and security to the network.
What is the next step for the Datamine Network alpha launch?
The development team is completing final platform polish and optimizations before sending out the initial round of Alpha invites.
· hodlforjesus · #dev-updates