The full screen icon should be moved to the record view heading as per the attached image...
Note that once the record view is in full screen mode, the "Exit full screen" icon is located in the heading as one would expect.
AND, there should be an option (a checkbox) in the record view properties to open a given record view to full screen by default.