Self-updating ( from WEB server HTTP ) OTA firmware for ESP8266 AND ESP32!

smartman · December 5, 2018, 3:42pm

I tried everything but result is the same !
“HTTP_UPDATE_FAILD Error (-106): Verify Bin Header Failed”
I don’t know what to do now, is it possible its because of the cloud hosting ? does anybody have files on VPS so i test it ?

mikekgr · December 6, 2018, 8:08am

did you see this:

github.com/esp8266/Arduino

HTTP_UPDATE_FAILD Error (-106): Verify bin header failed

opened 12:25PM - 07 Oct 17 UTC

closed 05:03PM - 08 Oct 17 UTC

djboulet

### Basic Infos #### Hardware Hardware: ESP8266 ESP-12E nodemcu v1.0 Core… Version: 2.4.0-rc1 (https://github.com/esp8266/Arduino/releases/download/2.4.0-rc1/package_esp8266com_index.json) ### Description ESP8266 loops with a HTTP_UPDATE_FAILD Error (-106) when no update required. Serial output as follows: [SETUP] WAIT 5... ~tate: 0 -> 2 (b0) state: 2 -> 3 (0) state: 3 -> 5 (10) add 0 aid 1 cnt connected with MYSSID, channel 6 dhcp client start... ip:192.168.2.205,mask:255.255.255.0,gw:192.168.2.1 [SETUP] WAIT 4... [SETUP] WAIT 3... [SETUP] WAIT 2... [SETUP] WAIT 1... HTTP_UPDATE_FAILD Error (-106): Verify bin header failed HTTP_UPDATE_FAILD Error (-106): Verify bin header failed HTTP_UPDATE_FAILD Error (-106): Verify bin header failed HTTP_UPDATE_FAILD Error (-106): Verify bin header failed ... ### Settings in IDE Module: NodeMCU 1.0 (ESP-12E Module) Flash Size: 4M (3M SPIFFS) CPU Frequency: 80 MHz Flash Mode: not sure Flash Frequency: not sure Upload Using: not sure Reset Method: not sure ### Sketch ```#include <Arduino.h> #include <ESP8266WiFi.h> #include <ESP8266WiFiMulti.h> #include <ESP8266HTTPClient.h> #include <ESP8266httpUpdate.h> #define USE_SERIAL Serial #define LED_OFF digitalWrite(LED_BUILTIN,HIGH) #define LED_ON digitalWrite(LED_BUILTIN,LOW) ESP8266WiFiMulti WiFiMulti; void setup() { USE_SERIAL.begin(115200); USE_SERIAL.setDebugOutput(true); USE_SERIAL.println(); USE_SERIAL.println(); USE_SERIAL.println(); for(uint8_t t = 5; t > 0; t--) { USE_SERIAL.printf("[SETUP] WAIT %d...\n", t); USE_SERIAL.flush(); delay(1000); } WiFiMulti.addAP("MYSSID", "password"); } void loop() { // wait for WiFi connection if((WiFiMulti.run() == WL_CONNECTED)) { t_httpUpdate_return ret = ESPhttpUpdate.update("192.168.2.110",80,"/index.php","httpUpdateDev.ino.nodemcu"); switch(ret) { case HTTP_UPDATE_FAILED: USE_SERIAL.printf("HTTP_UPDATE_FAILD Error (%d): %s\n", ESPhttpUpdate.getLastError(), ESPhttpUpdate.getLastErrorString().c_str()); break; case HTTP_UPDATE_NO_UPDATES: USE_SERIAL.println("HTTP_UPDATE_NO_UPDATES"); break; case HTTP_UPDATE_OK: USE_SERIAL.println("HTTP_UPDATE_OK"); break; } } } ``` This is the php script running on the server: ``` <?PHP header('Content-type: text/plain; charset=utf8', true); function check_header($name, $value = false) { if(!isset($_SERVER[$name])) { return false; } if($value && $_SERVER[$name] != $value) { return false; } return true; } function sendFile($path) { header($_SERVER["SERVER_PROTOCOL"].' 200 OK', true, 200); header('Content-Type: application/octet-stream', true); header('Content-Disposition: attachment; filename='.basename($path)); header('Content-Length: '.filesize($path), true); header('x-MD5: '.md5_file($path), true); readfile($path); } echo "PHP script starts\n"; if(!check_header('HTTP_USER_AGENT', 'ESP8266-http-Update')) { header($_SERVER["SERVER_PROTOCOL"].' 403 Forbidden', true, 403); echo "Invalid USER AGENT. This is only for ESP8266 updater!\n"; exit(); } echo "User agent test okay\n"; if( !check_header('HTTP_X_ESP8266_STA_MAC') || !check_header('HTTP_X_ESP8266_AP_MAC') || !check_header('HTTP_X_ESP8266_FREE_SPACE') || !check_header('HTTP_X_ESP8266_SKETCH_SIZE') || !check_header('HTTP_X_ESP8266_SKETCH_MD5') || !check_header('HTTP_X_ESP8266_CHIP_SIZE') || !check_header('HTTP_X_ESP8266_SDK_VERSION') ) { header($_SERVER["SERVER_PROTOCOL"].' 403 Forbidden', true, 403); echo "Problem with HTTP header from ESP8266 --- only for ESP8266 updater!\n"; exit(); } echo "Headers tested okay\n"; $db = array( "18:FE:AA:AA:AA:AA" => "DOOR-7-g14f53a19", "5C:CF:7F:B0:F2:14" => "httpUpdateDev.ino.nodemcu", "18:FE:AA:AA:AA:BB" => "TEMP-1.0.0" ); echo "MAC Database defined\n"; if(!isset($db[$_SERVER['HTTP_X_ESP8266_STA_MAC']])) { echo "MAC address not found in db\n"; header($_SERVER["SERVER_PROTOCOL"].' 500 ESP MAC not configured for updates', true, 500); } else { echo "MAC address found in db\n"; } $localBinary = "./bin/".$db[$_SERVER['HTTP_X_ESP8266_STA_MAC']].".bin"; echo "File name requested: $localBinary\n"; $localBinaryMD5 = md5_file($localBinary); // Check if version has been set and does not match, if not, check if // MD5 hash between local binary and ESP8266 binary do not match if not. // then no update has been found. $v1 = check_header('HTTP_X_ESP8266_SDK_VERSION'); echo "Version check parameters:\n HTTP_X_ESP8266_SDK_VERSION: {$_server['HTTP_X_ESP8266_SDK_VERSION']}\n HTTP_X_ESP8266_STA_MAC: {$_SERVER['HTTP_X_ESP8266_STA_MAC']}\n HTTP_X_ESP8266_VERSION: {$_SERVER['HTTP_X_ESP8266_VERSION']}\n HTTP_X_ESP8266_SKETCH_MD5: {$_SERVER['HTTP_X_ESP8266_SKETCH_MD5']}\n localmd5: $localBinaryMD5\n check_header('HTTP_X_ESP8266_SDK_VERSION'): $v1\n\n"; if($_SERVER["HTTP_X_ESP8266_SKETCH_MD5"] != md5_file($localBinary)) { echo "versions do not match - updating\n"; sendFile($localBinary); } else { echo "versions match - no action required\n"; header($_SERVER["SERVER_PROTOCOL"].' 304 Not Modified', true, 304); } header($_SERVER["SERVER_PROTOCOL"].' 500 no version for ESP MAC', true, 500); echo "End of script\n"; ?> ``` ### Debug Messages This is a sample of the TCP stream between the ESP8266 and the server: GET /index.php HTTP/1.0 Host: 192.168.2.110 User-Agent: ESP8266-http-Update Connection: close x-ESP8266-STA-MAC: 5C:CF:7F:B0:F2:14 x-ESP8266-AP-MAC: 5E:CF:7F:B0:F2:14 x-ESP8266-free-space: 778240 x-ESP8266-sketch-size: 269552 x-ESP8266-sketch-md5: 0b80225ec75c2ed95ecbecd227e53e38 x-ESP8266-chip-size: 4194304 x-ESP8266-sdk-version: 2.0.0(656edbf) x-ESP8266-mode: sketch x-ESP8266-version: httpUpdateDev.ino.nodemcu HTTP/1.1 200 OK Date: Sat, 07 Oct 2017 11:41:14 GMT Server: Apache/2.2.29 (Unix) mod_wsgi/3.5 Python/2.7.10 PHP/5.6.10 mod_ssl/2.2.29 OpenSSL/0.9.8zh DAV/2 mod_fastcgi/2.4.6 mod_perl/2.0.9 Perl/v5.22.0 X-Powered-By: PHP/5.6.10 Content-Length: 520 Connection: close Content-Type: text/plain; charset=utf8 PHP script starts User agent test okay Headers tested okay MAC Database defined MAC address found in db File name requested: ./bin/httpUpdateDev.ino.nodemcu.bin Version check parameters: HTTP_X_ESP8266_SDK_VERSION: HTTP_X_ESP8266_STA_MAC: 5C:CF:7F:B0:F2:14 HTTP_X_ESP8266_VERSION: httpUpdateDev.ino.nodemcu HTTP_X_ESP8266_SKETCH_MD5: 0b80225ec75c2ed95ecbecd227e53e38 localmd5: 0b80225ec75c2ed95ecbecd227e53e38 check_header('HTTP_X_ESP8266_SDK_VERSION'): 1 versions match - no action required End of script

???

also see this:

https://www.esp8266.com/viewtopic.php?f=6&t=17258

Costas · December 6, 2018, 8:17am

HI @mikekgr

I am going a bit off topic here but I wondered if you had used BearSSL yet?

I upgraded to ESP8266 2.4.2 today and I was expecting to have BearSSL available for selection in the Arduino IDE (under lwip). Maybe it’s just the libraries that are different.

I know there are some new examples like SecureBearSSLUpdater.ino and HelloServerBearSSL.ino etc.

2.4.2 gives just enough extra memory to do a few more SSL things that 2.4.1 didn’t allow.

Good to see that Blynk NTP time comes up correctly now plus all the other new features like URL button, images, number input widget etc.

mikekgr · December 6, 2018, 8:27am

Hello @Costas Paul, ( relative ) long time no see !
As far as I know ,the new under final debugging/cooking 2.5.0 will have full SSL support, I don’t know if 2.4.2 has partial support, because I sync the Arduino core master…

Best Regards,
Mike Kranidis

Costas · December 6, 2018, 8:28am

Do you have any idea when 2.5.0 will be available?

I did notice there were quite a few “BearSSL” commits after 2.4.2 release but I thought it was implemented in 2.4.2.

mikekgr · December 6, 2018, 8:38am

I think it is needed a couple of weeks but nobody can be sure…

Costas · December 7, 2018, 1:14am

Are there problems with the 2.4.2 release that warrants using the master?

mikekgr · December 7, 2018, 10:33am

No as far as I know but in Master there are more goods in development…

mikekgr · December 9, 2018, 8:16am

See here for the progress:

Costas · December 12, 2018, 12:56pm

Hi @mikekgr

I updated to ESP8266 core 2.5.0-beta1 today and it looks to be running ok.
The new https stream provided by BearSSL means I can reliably pull in 17,000 characters (34kb) with an API call to a crypto trading exchange. Free memory before I start adding my code, but with the API call included is an impressive, and stable, 46,176 bytes.

UdayPert · December 29, 2018, 7:20am

Hi, mikekgr,

I recently started working with esp8266, I did lots of work but am finally stuck with HTTP server OTA.
at that time recently saw your post I thought that this will work for me, I started doing work on that stuff. I uploaded two files what you said in your post(.version and .bin) but finally, I am getting an error like “HTTP_UPDATE_FAILD Error (-101): Server Did Not Report Size”. Now I am not understaing wht it is coming like this, can you please help for this error.

My total output is:

<CR><LF>
<CR><LF>
Version - 0.0.0<CR><LF>
Mode: STA<CR><LF>
PHY mode: N<CR><LF>
Channel: 1<CR><LF>
AP id: 0<CR><LF>
Status: 1<CR><LF>
Auto connect: 1<CR><LF>
SSID (7): Pert AP<CR><LF>
Passphrase (8): ta55yoka<CR><LF>
BSSID set: 0<CR><LF>
....Server DisconnectedSERVER_CONNECT<CR><LF>
107.22.160.4<CR><LF>
<CR><LF>
Checking for firmware updates.<CR><LF>
MAC address: 600194412A13<CR><LF>
Firmware version URL: http://18.136.149.198:3077/api/containers/espota/download/600194412A13.version<CR><LF>
Current firmware version: 18122801<CR><LF>
Available firmware version: 18122802<CR><LF>
Preparing to update<CR><LF>
Firmware image URL: http://18.136.149.198:3077/api/containers/espota/download/ESP12E_OTA.ino.generic.bin<CR><LF>
HTTP_UPDATE_FAILD Error (-101): Server Did Not Report Size

Costas · December 29, 2018, 10:04am

@UdayPert which Arduino ESP8266 core version are you using?

IBK · December 29, 2018, 7:38pm

@UdayPert: If I open the “Firmware image URL” mentioned above in a browser and check the content of the response header I don’t see “Content-Length” as a key.
That is why the result is “HTTP_UPDATE_FAILD Error (-101): Server Did Not Report Size”.

grafik

@Costas: This applies for all ESP8266 core versions up to the current 2.5.0-beta2.

UdayPert · December 31, 2018, 4:33am

@Costas: ESP8266 Core version 2.4.2(Stable version).

UdayPert · December 31, 2018, 4:36am

@IBK: Okay So where i need to mention the content leangth.

IBK · December 31, 2018, 8:30am

@UdayPert: As I said: “Content-Length” needs to be in the response header that comes from the http server.

UdayPert · December 31, 2018, 9:01am

@IBK My server person run that PHP script after that i got this response.

HTTP_UPDATE_FAILD Error (-100): Not Enough space

Costas · December 31, 2018, 9:18am

@UdayPert when you compile your sketch what sizes are shown.

A basic sketch is something like:
Sketch uses 331168 bytes (31%) of program storage space. Maximum is 1044464 bytes.

Sketch needs to be less than 50% for OTA update. That is space for original sketch and new sketch.

Costas · December 31, 2018, 9:21am

@UdayPert maybe you only have memory set to 512kb. Your bin file is 276kb which would be 54% i.e. too big.

UdayPert · December 31, 2018, 9:22am

@IBK: After code compile it shoes like this
Sketch uses 278396 bytes (55%) of program storage space. Maximum is 499696 bytes.
Global variables use 30100 bytes (36%) of dynamic memory, leaving 51820 bytes for local variables. Maximum is 81920 bytes.