Jul 31 09:30:48.473814 ip-10-0-141-129 systemd[1]: Starting Kubernetes Kubelet... Jul 31 09:30:48.902608 ip-10-0-141-129 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 09:30:48.902608 ip-10-0-141-129 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 31 09:30:48.902608 ip-10-0-141-129 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 09:30:48.902608 ip-10-0-141-129 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 31 09:30:48.902608 ip-10-0-141-129 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 09:30:48.903844 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.903740 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 31 09:30:48.909099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909084 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 09:30:48.909099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909100 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909104 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909107 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909111 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909114 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909118 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909122 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909126 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909129 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909133 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909136 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909139 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909141 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909144 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909147 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909150 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909153 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909156 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909158 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 09:30:48.909196 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909162 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909164 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909167 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909170 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909173 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909177 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909180 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909183 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909186 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909189 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909191 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909194 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909197 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909199 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909203 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909207 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909210 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909213 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909216 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 09:30:48.909663 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909219 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909221 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909224 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909227 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909230 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909233 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909235 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909238 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909241 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909243 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909245 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909248 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909250 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909253 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909255 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909259 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909262 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909264 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909267 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909269 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 09:30:48.910118 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909272 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909274 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909277 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909279 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909282 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909286 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909288 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909291 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909293 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909296 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909298 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909301 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909304 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909307 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909309 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909312 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909314 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909317 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909319 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909322 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 09:30:48.910610 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909324 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909327 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909329 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909332 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909334 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909336 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909339 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909342 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909345 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909348 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909350 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909353 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909356 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909358 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909361 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909364 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909366 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909369 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909371 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 09:30:48.911085 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.909374 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910068 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910076 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910079 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910082 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910085 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910088 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910091 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910094 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910096 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910099 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910102 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910105 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910107 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910110 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910112 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910115 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910118 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910121 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910123 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 09:30:48.911584 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910127 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910130 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910133 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910136 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910138 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910141 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910144 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910146 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910149 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910152 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910154 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910157 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910159 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910162 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910164 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910167 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910169 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910172 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910175 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910178 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 09:30:48.912168 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910181 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910183 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910186 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910188 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910191 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910193 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910196 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910199 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910201 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910204 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910206 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910223 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910228 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910231 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910234 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910237 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910240 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910243 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910247 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 09:30:48.912730 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910251 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910254 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910257 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910260 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910262 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910265 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910267 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910270 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910272 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910276 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910280 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910282 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910285 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910288 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910291 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910294 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910298 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910301 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910304 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910306 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 09:30:48.913253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910309 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910312 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910315 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910317 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910320 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910323 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910326 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910328 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910331 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910333 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910336 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910338 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910341 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910343 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910346 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910348 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910351 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910353 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910356 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910358 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 09:30:48.913805 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910360 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910722 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910726 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910729 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910732 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910735 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910738 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910740 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910743 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910746 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910749 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910751 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910754 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910756 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910759 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910762 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910767 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910771 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910774 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910777 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 09:30:48.914360 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910780 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910783 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910786 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910788 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910791 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910794 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910796 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910799 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910801 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910804 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910806 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910809 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910811 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910814 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910816 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910819 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910821 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910824 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910827 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 31 09:30:48.914899 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910829 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910832 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910835 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910837 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910839 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910842 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910845 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910848 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910851 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910853 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910856 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910859 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910861 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910864 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910867 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910869 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910871 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910874 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910877 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910879 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 09:30:48.915428 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910882 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910884 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910886 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910889 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910891 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910894 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910896 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910899 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910902 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910905 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910907 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910910 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910913 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910918 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910921 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910923 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910926 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910929 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910931 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910934 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 09:30:48.915945 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910936 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910939 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910942 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910944 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910947 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910949 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910952 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910954 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910957 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910959 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910962 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910964 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910967 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910971 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910974 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910977 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910980 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910983 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910987 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 09:30:48.916445 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910990 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.910992 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911059 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911066 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911073 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911078 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911087 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911092 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911098 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911102 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911105 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911109 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911112 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911115 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911118 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911121 2578 flags.go:64] FLAG: --cgroup-root="" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911124 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911127 2578 flags.go:64] FLAG: --client-ca-file="" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911129 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911132 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911137 2578 flags.go:64] FLAG: --cluster-domain="" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911139 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911142 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911146 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 31 09:30:48.917032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911149 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911153 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911155 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911159 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911162 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911165 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911170 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911173 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911176 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911180 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911184 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911187 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911189 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911192 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911196 2578 flags.go:64] FLAG: --enable-server="true" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911200 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911204 2578 flags.go:64] FLAG: --event-burst="100" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911207 2578 flags.go:64] FLAG: --event-qps="50" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911210 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911213 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911216 2578 flags.go:64] FLAG: --eviction-hard="" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911219 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911222 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911225 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911228 2578 flags.go:64] FLAG: --eviction-soft="" Jul 31 09:30:48.917671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911231 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911234 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911237 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911239 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911242 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911245 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911248 2578 flags.go:64] FLAG: --feature-gates="" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911251 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911255 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911257 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911260 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911263 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911266 2578 flags.go:64] FLAG: --help="false" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911270 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-141-129.ec2.internal" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911273 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911276 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911279 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911282 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911286 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911288 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911292 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911295 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911298 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 31 09:30:48.918265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911301 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911304 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911307 2578 flags.go:64] FLAG: --kube-reserved="" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911310 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911313 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911316 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911318 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911321 2578 flags.go:64] FLAG: --lock-file="" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911324 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911327 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911330 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911335 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911338 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911340 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911343 2578 flags.go:64] FLAG: --logging-format="text" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911346 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911349 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911352 2578 flags.go:64] FLAG: --manifest-url="" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911354 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911358 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911361 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911365 2578 flags.go:64] FLAG: --max-pods="110" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911369 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911372 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911375 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 31 09:30:48.918863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911378 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911381 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911384 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911387 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911394 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911398 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911401 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911404 2578 flags.go:64] FLAG: --pod-cidr="" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911407 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911412 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911415 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911419 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911422 2578 flags.go:64] FLAG: --port="10250" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911425 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911428 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09edf9e5d166c7491" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911431 2578 flags.go:64] FLAG: --qos-reserved="" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911434 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911437 2578 flags.go:64] FLAG: --register-node="true" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911440 2578 flags.go:64] FLAG: --register-with-taints="" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911443 2578 flags.go:64] FLAG: --registry-burst="10" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911446 2578 flags.go:64] FLAG: --registry-qps="5" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911449 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911452 2578 flags.go:64] FLAG: --reserved-memory="" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911455 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911458 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 31 09:30:48.919470 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911461 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911464 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911466 2578 flags.go:64] FLAG: --runonce="false" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911469 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911474 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911477 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911479 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911482 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911485 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911488 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911491 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911494 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911510 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911516 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911520 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911523 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911527 2578 flags.go:64] FLAG: --system-cgroups="" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911530 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911535 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911538 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911553 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911558 2578 flags.go:64] FLAG: --tls-min-version="" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911561 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911564 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911567 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 31 09:30:48.920067 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911570 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911573 2578 flags.go:64] FLAG: --v="2" Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911576 2578 flags.go:64] FLAG: --version="false" Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911580 2578 flags.go:64] FLAG: --vmodule="" Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911583 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911587 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911696 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911700 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911703 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911706 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911708 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911713 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911715 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911718 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911721 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911723 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911726 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911729 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911733 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911737 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 09:30:48.920709 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911740 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911743 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911746 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911749 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911752 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911754 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911758 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911761 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911763 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911766 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911768 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911771 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911773 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911776 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911778 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911781 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911783 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911786 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911788 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911790 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 09:30:48.921236 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911793 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911795 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911798 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911802 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911804 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911807 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911809 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911812 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911815 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911817 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911820 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911822 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911826 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911830 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911832 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911835 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911838 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911842 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911844 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 09:30:48.921736 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911847 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911850 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911852 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911855 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911857 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911860 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911862 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911865 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911867 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911870 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911872 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911874 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911877 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911880 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911882 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911885 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911889 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911891 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911893 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911896 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 09:30:48.922191 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911899 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911901 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911904 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911906 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911909 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911913 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911916 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911919 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911922 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911925 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911927 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911930 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911933 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911935 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911937 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911940 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911943 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911945 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911948 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 09:30:48.922688 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911950 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911953 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911955 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911958 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911960 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911963 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.911965 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.911971 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.918481 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.918494 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.919780 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.919790 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919845 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919850 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919853 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 09:30:48.923146 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919856 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919859 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919862 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919866 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919870 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919873 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919875 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919878 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919880 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919884 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919887 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919890 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919892 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919895 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919897 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919900 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919902 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919906 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919910 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 09:30:48.923511 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919913 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919916 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919919 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919922 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919924 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919927 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919929 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919933 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919935 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919938 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919941 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919944 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919947 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919949 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919952 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919954 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919957 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919960 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919962 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919965 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 09:30:48.923984 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919968 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919971 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919973 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919976 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919979 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919982 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919984 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919987 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919989 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919992 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919994 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919997 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.919999 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920002 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920004 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920007 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920009 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920011 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920014 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920017 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 09:30:48.924482 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920020 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920022 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920025 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920027 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920031 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920035 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920037 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920040 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920043 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920046 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920048 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920051 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920053 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920056 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920059 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920061 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920064 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920067 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920070 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 09:30:48.924977 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920072 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920075 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920078 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920081 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920084 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920086 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920089 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920091 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920094 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920096 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920099 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920101 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920104 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920107 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920110 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920113 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920115 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 09:30:48.925426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920118 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.920123 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920226 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920231 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920242 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920245 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920248 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920251 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920253 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920256 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920258 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920261 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920263 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920267 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920270 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 09:30:48.925864 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920274 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920277 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920280 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920283 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920285 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920289 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920292 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920295 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920298 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920301 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920303 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920306 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920309 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920312 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920315 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920317 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920320 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920322 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920325 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 09:30:48.926276 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920328 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920330 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920333 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920335 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920338 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920340 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920343 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920345 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920347 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920350 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920352 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920355 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920358 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920376 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920380 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920383 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920386 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920389 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920391 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920394 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 09:30:48.927099 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920397 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920399 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920402 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920404 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920407 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920409 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920412 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920415 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920417 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920420 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920422 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920425 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920427 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920430 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920432 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920436 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920440 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920443 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920446 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 09:30:48.927821 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920448 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920451 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920454 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920456 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920459 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920462 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920465 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920467 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920470 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920472 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920474 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920477 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920479 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920482 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920484 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920486 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920489 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920491 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920494 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920497 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 09:30:48.928301 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920499 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920502 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920504 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920507 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920509 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920512 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920514 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:48.920516 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.920521 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.920626 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.922573 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.923852 2578 server.go:1019] "Starting client certificate rotation" Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.923943 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 09:30:48.928827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.923971 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 09:30:48.929147 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.928436 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 09:30:48.932913 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.932898 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 09:30:48.946135 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.946116 2578 log.go:25] "Validated CRI v1 runtime API" Jul 31 09:30:48.949283 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.949269 2578 log.go:25] "Validated CRI v1 image API" Jul 31 09:30:48.950956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.950941 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 31 09:30:48.953233 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.953214 2578 fs.go:135] Filesystem UUIDs: map[5559cf48-c524-456e-bc53-1af4168f0b33:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b29f667f-8f01-446d-975f-67383180b84a:/dev/nvme0n1p4] Jul 31 09:30:48.953299 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.953232 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 31 09:30:48.953795 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.953779 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 09:30:48.957775 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.957674 2578 manager.go:216] Machine: {Timestamp:2026-07-31 09:30:48.957199692 +0000 UTC m=+0.363729812 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098305 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2251b5cbc0ca420645652d1d6163cd SystemUUID:ec2251b5-cbc0-ca42-0645-652d1d6163cd BootID:34420dec-843b-4a5b-8fbe-2827e47630be Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:71:55:26:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:71:55:26:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:46:76:26:f8:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 31 09:30:48.957775 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.957772 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 31 09:30:48.957880 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.957870 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 31 09:30:48.959657 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.959634 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 31 09:30:48.959779 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.959660 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 31 09:30:48.960456 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.960446 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 31 09:30:48.960494 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.960459 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 31 09:30:48.960494 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.960466 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 09:30:48.960494 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.960479 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 09:30:48.961251 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.961242 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 31 09:30:48.964499 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.964487 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 31 09:30:48.964626 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.964617 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 31 09:30:48.964660 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.964646 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 31 09:30:48.964660 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.964656 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 31 09:30:48.964716 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.964674 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 31 09:30:48.964716 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.964683 2578 kubelet.go:398] "Adding apiserver pod source" Jul 31 09:30:48.964716 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.964697 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 31 09:30:48.965006 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.964994 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 09:30:48.965045 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.965012 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 09:30:48.969035 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.969008 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 31 09:30:48.971305 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.971285 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 31 09:30:48.971371 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.971332 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 31 09:30:48.972667 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972653 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 31 09:30:48.972667 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972670 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972676 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972681 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972694 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972709 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972720 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972728 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972737 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972744 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972757 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 31 09:30:48.972774 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972765 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 31 09:30:48.973041 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972805 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 31 09:30:48.973041 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:48.972804 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 31 09:30:48.973041 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.972812 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 31 09:30:48.973041 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:48.972934 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 31 09:30:48.975853 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.975842 2578 server.go:1268] "Started kubelet" Jul 31 09:30:48.975946 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.975916 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 31 09:30:48.976032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.975915 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 31 09:30:48.976032 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.975983 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 31 09:30:48.976465 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.976429 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dq8b4" Jul 31 09:30:48.976688 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.976666 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 31 09:30:48.976693 ip-10-0-141-129 systemd[1]: Started Kubernetes Kubelet. Jul 31 09:30:48.976933 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.976917 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 31 09:30:48.978195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.978179 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 31 09:30:48.980279 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:48.980264 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 31 09:30:48.981405 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.981387 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 31 09:30:48.981405 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.981395 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 31 09:30:48.981559 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:48.981530 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:48.982037 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982021 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 31 09:30:48.982136 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982083 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 31 09:30:48.982136 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982098 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 31 09:30:48.982234 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982175 2578 factory.go:55] Registering systemd factory Jul 31 09:30:48.982234 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982189 2578 factory.go:223] Registration of the systemd container factory successfully Jul 31 09:30:48.982234 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982231 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 31 09:30:48.982369 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982239 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 31 09:30:48.982415 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982388 2578 factory.go:153] Registering CRI-O factory Jul 31 09:30:48.982415 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982402 2578 factory.go:223] Registration of the crio container factory successfully Jul 31 09:30:48.982495 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982452 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 31 09:30:48.982495 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982477 2578 factory.go:103] Registering Raw factory Jul 31 09:30:48.982608 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982497 2578 manager.go:1196] Started watching for new ooms in manager Jul 31 09:30:48.982805 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.982794 2578 manager.go:349] Starting recovery of all containers Jul 31 09:30:48.984940 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.984920 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dq8b4" Jul 31 09:30:48.986502 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:48.986476 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 31 09:30:48.986660 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:48.986638 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 31 09:30:48.993879 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:48.986703 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-129.ec2.internal.18c755ebe82097df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-129.ec2.internal,UID:ip-10-0-141-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-129.ec2.internal,},FirstTimestamp:2026-07-31 09:30:48.975816671 +0000 UTC m=+0.382346791,LastTimestamp:2026-07-31 09:30:48.975816671 +0000 UTC m=+0.382346791,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-129.ec2.internal,}" Jul 31 09:30:48.996966 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:48.996949 2578 manager.go:354] Recovery completed Jul 31 09:30:48.998469 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:48.998447 2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 31 09:30:49.002372 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.002360 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 09:30:49.004035 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.004021 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory" Jul 31 09:30:49.004089 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.004047 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 09:30:49.004089 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.004058 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID" Jul 31 09:30:49.004530 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.004516 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 31 09:30:49.004530 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.004528 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 31 09:30:49.004626 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.004530 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 09:30:49.004626 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.004558 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 31 09:30:49.005174 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.005160 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory" Jul 31 09:30:49.005243 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.005187 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 09:30:49.005243 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.005202 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID" Jul 31 09:30:49.005387 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.005375 2578 policy_none.go:49] "None policy: Start" Jul 31 09:30:49.005425 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.005395 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 31 09:30:49.005425 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.005405 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 31 09:30:49.006317 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.006307 2578 policy_none.go:47] "Start" Jul 31 09:30:49.045149 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.045017 2578 manager.go:337] "Starting Device Plugin manager" Jul 31 09:30:49.045225 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.045185 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 31 09:30:49.045225 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.045199 2578 server.go:87] "Starting device plugin registration server" Jul 31 09:30:49.045396 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.045385 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 31 09:30:49.045431 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.045399 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 31 09:30:49.045522 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.045507 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 31 09:30:49.045612 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.045601 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 31 09:30:49.045661 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.045613 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 31 09:30:49.046047 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.046024 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 31 09:30:49.046093 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.046075 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.082490 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.082468 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 31 09:30:49.090248 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.083723 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 31 09:30:49.090248 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.083762 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 31 09:30:49.090248 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.083784 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 31 09:30:49.090248 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.083824 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 31 09:30:49.090248 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.086119 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 09:30:49.146051 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.146033 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 09:30:49.146754 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.146741 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory" Jul 31 09:30:49.146836 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.146770 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 09:30:49.146836 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.146786 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID" Jul 31 09:30:49.146836 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.146813 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.157133 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.157060 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.157133 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.157084 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-129.ec2.internal\": node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.174210 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.174187 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.184514 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.184484 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal"] Jul 31 09:30:49.184584 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.184565 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 09:30:49.185801 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.185786 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory" Jul 31 09:30:49.185889 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.185817 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 09:30:49.185889 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.185832 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID" Jul 31 09:30:49.188155 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.188141 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 09:30:49.188281 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.188266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.188324 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.188297 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 09:30:49.188890 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.188874 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory" Jul 31 09:30:49.188890 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.188886 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory" Jul 31 09:30:49.189035 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.188903 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 09:30:49.189035 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.188919 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID" Jul 31 09:30:49.189035 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.188906 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 09:30:49.189035 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.188982 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID" Jul 31 09:30:49.191198 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.191183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.191266 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.191205 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 09:30:49.193030 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.193012 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory" Jul 31 09:30:49.193122 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.193041 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 09:30:49.193122 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.193056 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID" Jul 31 09:30:49.210212 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.210192 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-129.ec2.internal\" not found" node="ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.215910 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.215896 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-129.ec2.internal\" not found" node="ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.275328 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.275293 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.283353 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.283328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee672bbfd11f27c89b8358578ceac4a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"ee672bbfd11f27c89b8358578ceac4a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.283439 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.283363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee672bbfd11f27c89b8358578ceac4a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"ee672bbfd11f27c89b8358578ceac4a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.283439 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.283391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/972297024dddeb976ba6e91301bc1a0d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-129.ec2.internal\" (UID: \"972297024dddeb976ba6e91301bc1a0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.376221 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.376174 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.384105 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.384075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee672bbfd11f27c89b8358578ceac4a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"ee672bbfd11f27c89b8358578ceac4a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.384217 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.384114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee672bbfd11f27c89b8358578ceac4a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"ee672bbfd11f27c89b8358578ceac4a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.384217 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.384141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/972297024dddeb976ba6e91301bc1a0d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-129.ec2.internal\" (UID: \"972297024dddeb976ba6e91301bc1a0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.384217 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.384177 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/972297024dddeb976ba6e91301bc1a0d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-129.ec2.internal\" (UID: \"972297024dddeb976ba6e91301bc1a0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.384217 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.384183 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee672bbfd11f27c89b8358578ceac4a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"ee672bbfd11f27c89b8358578ceac4a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.384217 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.384185 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee672bbfd11f27c89b8358578ceac4a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"ee672bbfd11f27c89b8358578ceac4a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.476530 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.476437 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.513566 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.513530 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.519438 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.519125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" Jul 31 09:30:49.577621 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.577572 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.685252 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.685214 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.786603 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.786522 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.886859 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.886823 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.924853 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.924822 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 31 09:30:49.925290 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.924998 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 09:30:49.986936 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:49.986905 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:49.992791 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.992759 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 09:25:49 +0000 UTC" deadline="2028-02-09 07:12:54.231372899 +0000 UTC" Jul 31 09:30:49.992791 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:49.992787 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13389h42m4.238588953s" Jul 31 09:30:50.079080 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.079048 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 09:30:50.087127 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:50.087097 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found" Jul 31 09:30:50.109591 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.109555 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 09:30:50.119408 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.119385 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 09:30:50.167431 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:50.167397 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee672bbfd11f27c89b8358578ceac4a3.slice/crio-f39464fbe6d2b0e010779c9fc85975f0f6c921c2a72be1f06e791916af9c3711 WatchSource:0}: Error finding container f39464fbe6d2b0e010779c9fc85975f0f6c921c2a72be1f06e791916af9c3711: Status 404 returned error can't find the container with id f39464fbe6d2b0e010779c9fc85975f0f6c921c2a72be1f06e791916af9c3711 Jul 31 09:30:50.174668 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.174649 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 09:30:50.180706 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:50.180685 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972297024dddeb976ba6e91301bc1a0d.slice/crio-a6497a8c0f45af77664bca1b500c1bfa0c51926e92a74d0c392840e415a33cca WatchSource:0}: Error finding container a6497a8c0f45af77664bca1b500c1bfa0c51926e92a74d0c392840e415a33cca: Status 404 returned error can't find the container with id a6497a8c0f45af77664bca1b500c1bfa0c51926e92a74d0c392840e415a33cca Jul 31 09:30:50.181670 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.181655 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" Jul 31 09:30:50.193821 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.193800 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 09:30:50.195073 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.195058 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" Jul 31 09:30:50.204724 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.204708 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 09:30:50.965447 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.965408 2578 apiserver.go:52] "Watching apiserver" Jul 31 09:30:50.975012 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.974979 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 31 09:30:50.975516 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.975486 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-mnxct","openshift-multus/multus-mcx7k","openshift-multus/network-metrics-daemon-9cbhc","kube-system/global-pull-secret-syncer-9f5rs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8","openshift-dns/node-resolver-q2pvs","openshift-network-diagnostics/network-check-target-z65mq","openshift-network-operator/iptables-alerter-8w8mm","openshift-ovn-kubernetes/ovnkube-node-76zkr","kube-system/konnectivity-agent-mfrps","kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6hvrv","openshift-image-registry/node-ca-m2fjx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"] Jul 31 09:30:50.978218 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.978194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:50.978339 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:50.978279 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:30:50.980527 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.980500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:50.983218 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.982840 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 31 09:30:50.983218 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.982967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:50.983218 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:50.983037 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:30:50.984085 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.983727 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cbsm7\"" Jul 31 09:30:50.984085 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.983770 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 31 09:30:50.984085 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.983783 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 31 09:30:50.984085 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.983783 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 31 09:30:50.985347 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.985325 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:50.985485 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:50.985410 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:30:50.988729 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.987824 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:50.990356 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.990334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:50.992464 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.992439 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 31 09:30:50.992695 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.992672 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 31 09:30:50.992935 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.992865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 31 09:30:50.993650 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.993629 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bkg4f\"" Jul 31 09:30:50.993872 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.993852 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 31 09:30:50.994106 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994089 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6wgp8\"" Jul 31 09:30:50.994270 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/545bfd62-358c-4743-80df-242a578ecf2f-serviceca\") pod \"node-ca-m2fjx\" (UID: \"545bfd62-358c-4743-80df-242a578ecf2f\") " pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:50.994350 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p78ql\" (UniqueName: \"kubernetes.io/projected/545bfd62-358c-4743-80df-242a578ecf2f-kube-api-access-p78ql\") pod \"node-ca-m2fjx\" (UID: \"545bfd62-358c-4743-80df-242a578ecf2f\") " pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:50.994350 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994302 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 31 09:30:50.994350 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11f6c97c-7d6f-4745-9d75-4a3577df3081-kubelet-config\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:50.994350 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11f6c97c-7d6f-4745-9d75-4a3577df3081-dbus\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:50.994555 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:50.994555 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/545bfd62-358c-4743-80df-242a578ecf2f-host\") pod \"node-ca-m2fjx\" (UID: \"545bfd62-358c-4743-80df-242a578ecf2f\") " pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:50.994555 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:50.994555 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph86v\" (UniqueName: \"kubernetes.io/projected/d83740ca-ebfe-45da-bee7-220b954c33d3-kube-api-access-ph86v\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:50.994555 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.994500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:50.998423 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.997488 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:50.999394 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:50.998638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.000721 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.000670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.001981 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.001831 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 31 09:30:51.002087 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.002064 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 31 09:30:51.002154 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.002113 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 31 09:30:51.002216 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.002066 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 31 09:30:51.002320 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.002303 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 31 09:30:51.002410 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.002390 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 31 09:30:51.002471 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.002443 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 31 09:30:51.002603 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.002584 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 09:30:51.002862 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.002768 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 31 09:30:51.003726 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.003435 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6qxxr\"" Jul 31 09:30:51.003726 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.003450 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 31 09:30:51.003873 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.003854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:30:51.003873 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.003869 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ccqc6\"" Jul 31 09:30:51.003977 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.003930 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 31 09:30:51.004231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.004211 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x6hs2\"" Jul 31 09:30:51.004423 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.004405 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 31 09:30:51.004495 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.004410 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 31 09:30:51.006134 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.006113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.006954 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.006934 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 31 09:30:51.007270 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.007250 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9f94q\"" Jul 31 09:30:51.007351 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.007284 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 31 09:30:51.009024 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.008734 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 31 09:30:51.009024 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.008866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.009583 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.009551 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 31 09:30:51.009684 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.009657 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-brq62\"" Jul 31 09:30:51.009747 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.009681 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 31 09:30:51.011749 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.011730 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 31 09:30:51.011915 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.011902 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dk9kl\"" Jul 31 09:30:51.012196 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.012177 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 31 09:30:51.025391 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.025374 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dhsbc" Jul 31 09:30:51.034469 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.034164 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dhsbc" Jul 31 09:30:51.082977 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.082948 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 31 09:30:51.088777 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.088723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" event={"ID":"972297024dddeb976ba6e91301bc1a0d","Type":"ContainerStarted","Data":"a6497a8c0f45af77664bca1b500c1bfa0c51926e92a74d0c392840e415a33cca"} Jul 31 09:30:51.090108 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.090079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" event={"ID":"ee672bbfd11f27c89b8358578ceac4a3","Type":"ContainerStarted","Data":"f39464fbe6d2b0e010779c9fc85975f0f6c921c2a72be1f06e791916af9c3711"} Jul 31 09:30:51.094718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-run-netns\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.094830 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094724 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-sysctl-d\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.094830 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-run-ovn\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.094830 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-kubernetes\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.094998 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-sys\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.094998 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11f6c97c-7d6f-4745-9d75-4a3577df3081-kubelet-config\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:51.094998 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-cni-dir\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.094998 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-run-ovn-kubernetes\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.094998 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:51.094998 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.094984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-os-release\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9348038-f3b2-4684-a64a-147c84fc36d7-agent-certs\") pod \"konnectivity-agent-mfrps\" (UID: \"c9348038-f3b2-4684-a64a-147c84fc36d7\") " pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5326e31-5f50-437e-9a58-c99c0be38f46-host-slash\") pod \"iptables-alerter-8w8mm\" (UID: \"c5326e31-5f50-437e-9a58-c99c0be38f46\") " pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-device-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-etc-openvswitch\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-node-log\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-os-release\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-run-netns\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9348038-f3b2-4684-a64a-147c84fc36d7-konnectivity-ca\") pod \"konnectivity-agent-mfrps\" (UID: \"c9348038-f3b2-4684-a64a-147c84fc36d7\") " pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:30:51.095267 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-socket-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095288 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11f6c97c-7d6f-4745-9d75-4a3577df3081-kubelet-config\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-var-lib-kubelet\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-socket-dir-parent\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprn7\" (UniqueName: \"kubernetes.io/projected/c5326e31-5f50-437e-9a58-c99c0be38f46-kube-api-access-fprn7\") pod \"iptables-alerter-8w8mm\" (UID: \"c5326e31-5f50-437e-9a58-c99c0be38f46\") " pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-kubelet-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.095428 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-env-overrides\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-sysconfig\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.095547 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret podName:11f6c97c-7d6f-4745-9d75-4a3577df3081 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:51.595523871 +0000 UTC m=+3.002053979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret") pod "global-pull-secret-syncer-9f5rs" (UID: "11f6c97c-7d6f-4745-9d75-4a3577df3081") : object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bd7c33b-667b-453f-9849-1f5ae785a3fc-tmp\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11f6c97c-7d6f-4745-9d75-4a3577df3081-dbus\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c86319d-26ad-4dc0-938c-2fc9e87a8945-hosts-file\") pod \"node-resolver-q2pvs\" (UID: \"3c86319d-26ad-4dc0-938c-2fc9e87a8945\") " pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.095703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdhx5\" (UniqueName: \"kubernetes.io/projected/3c86319d-26ad-4dc0-938c-2fc9e87a8945-kube-api-access-tdhx5\") pod \"node-resolver-q2pvs\" (UID: \"3c86319d-26ad-4dc0-938c-2fc9e87a8945\") " pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph86v\" (UniqueName: \"kubernetes.io/projected/d83740ca-ebfe-45da-bee7-220b954c33d3-kube-api-access-ph86v\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-kubelet\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-run-openvswitch\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095895 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11f6c97c-7d6f-4745-9d75-4a3577df3081-dbus\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/545bfd62-358c-4743-80df-242a578ecf2f-serviceca\") pod \"node-ca-m2fjx\" (UID: \"545bfd62-358c-4743-80df-242a578ecf2f\") " pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.095989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p78ql\" (UniqueName: \"kubernetes.io/projected/545bfd62-358c-4743-80df-242a578ecf2f-kube-api-access-p78ql\") pod \"node-ca-m2fjx\" (UID: \"545bfd62-358c-4743-80df-242a578ecf2f\") " pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-daemon-config\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-etc-selinux\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-tuned\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:51.096231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mqvb\" (UniqueName: \"kubernetes.io/projected/3b283adb-9daf-493b-82da-5fb2e92ff59b-kube-api-access-4mqvb\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-sys-fs\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-run-systemd\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-var-lib-openvswitch\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-log-socket\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.096393 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-system-cni-dir\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7044dae5-8825-4d90-aab4-30b47b5600e2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096441 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/545bfd62-358c-4743-80df-242a578ecf2f-serviceca\") pod \"node-ca-m2fjx\" (UID: \"545bfd62-358c-4743-80df-242a578ecf2f\") " pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.096471 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs podName:d83740ca-ebfe-45da-bee7-220b954c33d3 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:51.596451273 +0000 UTC m=+3.002981397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs") pod "network-metrics-daemon-9cbhc" (UID: "d83740ca-ebfe-45da-bee7-220b954c33d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-system-cni-dir\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-run-k8s-cni-cncf-io\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-conf-dir\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-etc-kubernetes\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096671 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5326e31-5f50-437e-9a58-c99c0be38f46-iptables-alerter-script\") pod \"iptables-alerter-8w8mm\" (UID: \"c5326e31-5f50-437e-9a58-c99c0be38f46\") " pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.096827 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/545bfd62-358c-4743-80df-242a578ecf2f-host\") pod \"node-ca-m2fjx\" (UID: \"545bfd62-358c-4743-80df-242a578ecf2f\") " pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-cnibin\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-var-lib-cni-bin\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-hostroot\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-registration-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-slash\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-cni-netd\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-ovnkube-config\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-ovn-node-metrics-cert\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-ovnkube-script-lib\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-run\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-host\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.096995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pn4d\" (UniqueName: \"kubernetes.io/projected/4bd7c33b-667b-453f-9849-1f5ae785a3fc-kube-api-access-5pn4d\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7044dae5-8825-4d90-aab4-30b47b5600e2-cni-binary-copy\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzcqn\" (UniqueName: \"kubernetes.io/projected/7044dae5-8825-4d90-aab4-30b47b5600e2-kube-api-access-kzcqn\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-cnibin\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.097725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmf59\" (UniqueName: \"kubernetes.io/projected/c6a89ca4-f4d4-4f04-99d2-85868a438513-kube-api-access-zmf59\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5jct\" (UniqueName: \"kubernetes.io/projected/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-kube-api-access-p5jct\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-modprobe-d\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7044dae5-8825-4d90-aab4-30b47b5600e2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b283adb-9daf-493b-82da-5fb2e92ff59b-cni-binary-copy\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-var-lib-cni-multus\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-run-multus-certs\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-systemd-units\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c86319d-26ad-4dc0-938c-2fc9e87a8945-tmp-dir\") pod \"node-resolver-q2pvs\" (UID: \"3c86319d-26ad-4dc0-938c-2fc9e87a8945\") " pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-cni-bin\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-sysctl-conf\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-systemd\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-lib-modules\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-var-lib-kubelet\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.098195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.097576 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/545bfd62-358c-4743-80df-242a578ecf2f-host\") pod \"node-ca-m2fjx\" (UID: \"545bfd62-358c-4743-80df-242a578ecf2f\") " pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:51.105522 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.105502 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 09:30:51.105522 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.105523 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 09:30:51.105666 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.105534 2578 projected.go:196] Error preparing data for projected volume kube-api-access-9xbx2 for pod openshift-network-diagnostics/network-check-target-z65mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:51.105666 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.105591 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2 podName:15756e9c-2f7b-453a-995f-e13c9bd0be46 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:51.605578408 +0000 UTC m=+3.012108517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9xbx2" (UniqueName: "kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2") pod "network-check-target-z65mq" (UID: "15756e9c-2f7b-453a-995f-e13c9bd0be46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:51.105813 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.105792 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 31 09:30:51.109365 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.109344 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph86v\" (UniqueName: \"kubernetes.io/projected/d83740ca-ebfe-45da-bee7-220b954c33d3-kube-api-access-ph86v\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:51.109473 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.109433 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p78ql\" (UniqueName: \"kubernetes.io/projected/545bfd62-358c-4743-80df-242a578ecf2f-kube-api-access-p78ql\") pod \"node-ca-m2fjx\" (UID: \"545bfd62-358c-4743-80df-242a578ecf2f\") " pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:51.197735 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mqvb\" (UniqueName: \"kubernetes.io/projected/3b283adb-9daf-493b-82da-5fb2e92ff59b-kube-api-access-4mqvb\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.197735 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-sys-fs\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-run-systemd\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-var-lib-openvswitch\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-log-socket\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197841 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-sys-fs\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197845 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-run-systemd\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-system-cni-dir\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-log-socket\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197897 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-system-cni-dir\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197877 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-var-lib-openvswitch\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7044dae5-8825-4d90-aab4-30b47b5600e2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.197956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-system-cni-dir\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-run-k8s-cni-cncf-io\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.197990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-conf-dir\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-etc-kubernetes\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198022 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-run-k8s-cni-cncf-io\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198030 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-system-cni-dir\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5326e31-5f50-437e-9a58-c99c0be38f46-iptables-alerter-script\") pod \"iptables-alerter-8w8mm\" (UID: \"c5326e31-5f50-437e-9a58-c99c0be38f46\") " pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-cnibin\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198071 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-conf-dir\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198082 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-etc-kubernetes\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-var-lib-cni-bin\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-hostroot\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-registration-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-slash\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-cni-netd\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198232 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-var-lib-cni-bin\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-ovnkube-config\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198270 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-registration-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.198532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-ovn-node-metrics-cert\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-slash\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198134 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-cnibin\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-ovnkube-script-lib\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198333 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-hostroot\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198400 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-cni-netd\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-run\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-host\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198643 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7044dae5-8825-4d90-aab4-30b47b5600e2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pn4d\" (UniqueName: \"kubernetes.io/projected/4bd7c33b-667b-453f-9849-1f5ae785a3fc-kube-api-access-5pn4d\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198728 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5326e31-5f50-437e-9a58-c99c0be38f46-iptables-alerter-script\") pod \"iptables-alerter-8w8mm\" (UID: \"c5326e31-5f50-437e-9a58-c99c0be38f46\") " pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198692 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-run\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-host\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7044dae5-8825-4d90-aab4-30b47b5600e2-cni-binary-copy\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcqn\" (UniqueName: \"kubernetes.io/projected/7044dae5-8825-4d90-aab4-30b47b5600e2-kube-api-access-kzcqn\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-cnibin\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmf59\" (UniqueName: \"kubernetes.io/projected/c6a89ca4-f4d4-4f04-99d2-85868a438513-kube-api-access-zmf59\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.199427 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-ovnkube-config\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5jct\" (UniqueName: \"kubernetes.io/projected/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-kube-api-access-p5jct\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-modprobe-d\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-cnibin\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.198997 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-ovnkube-script-lib\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7044dae5-8825-4d90-aab4-30b47b5600e2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b283adb-9daf-493b-82da-5fb2e92ff59b-cni-binary-copy\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-var-lib-cni-multus\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199138 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-modprobe-d\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-run-multus-certs\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-systemd-units\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c86319d-26ad-4dc0-938c-2fc9e87a8945-tmp-dir\") pod \"node-resolver-q2pvs\" (UID: \"3c86319d-26ad-4dc0-938c-2fc9e87a8945\") " pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199206 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-var-lib-cni-multus\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-cni-bin\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-sysctl-conf\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199254 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7044dae5-8825-4d90-aab4-30b47b5600e2-cni-binary-copy\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-systemd-units\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-systemd\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.200358 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199287 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-run-multus-certs\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-cni-bin\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-lib-modules\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-var-lib-kubelet\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-sysctl-conf\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-run-netns\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199466 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-systemd\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-sysctl-d\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199498 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-lib-modules\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199533 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-var-lib-kubelet\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199538 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-run-netns\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199544 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c86319d-26ad-4dc0-938c-2fc9e87a8945-tmp-dir\") pod \"node-resolver-q2pvs\" (UID: \"3c86319d-26ad-4dc0-938c-2fc9e87a8945\") " pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-run-ovn\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-run-ovn\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-kubernetes\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-sys\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199664 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-sysctl-d\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-cni-dir\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.201341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7044dae5-8825-4d90-aab4-30b47b5600e2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-kubernetes\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-run-ovn-kubernetes\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199714 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-sys\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-cni-dir\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199738 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-run-ovn-kubernetes\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199779 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b283adb-9daf-493b-82da-5fb2e92ff59b-cni-binary-copy\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-os-release\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-os-release\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9348038-f3b2-4684-a64a-147c84fc36d7-agent-certs\") pod \"konnectivity-agent-mfrps\" (UID: \"c9348038-f3b2-4684-a64a-147c84fc36d7\") " pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5326e31-5f50-437e-9a58-c99c0be38f46-host-slash\") pod \"iptables-alerter-8w8mm\" (UID: \"c5326e31-5f50-437e-9a58-c99c0be38f46\") " pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-device-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-etc-openvswitch\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-node-log\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199931 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5326e31-5f50-437e-9a58-c99c0be38f46-host-slash\") pod \"iptables-alerter-8w8mm\" (UID: \"c5326e31-5f50-437e-9a58-c99c0be38f46\") " pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199968 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-device-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.202330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199982 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-etc-openvswitch\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.199988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-os-release\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-run-netns\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200017 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-node-log\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9348038-f3b2-4684-a64a-147c84fc36d7-konnectivity-ca\") pod \"konnectivity-agent-mfrps\" (UID: \"c9348038-f3b2-4684-a64a-147c84fc36d7\") " pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7044dae5-8825-4d90-aab4-30b47b5600e2-os-release\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200065 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-host-run-netns\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-socket-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-var-lib-kubelet\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-socket-dir-parent\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-var-lib-kubelet\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200187 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-socket-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-socket-dir-parent\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprn7\" (UniqueName: \"kubernetes.io/projected/c5326e31-5f50-437e-9a58-c99c0be38f46-kube-api-access-fprn7\") pod \"iptables-alerter-8w8mm\" (UID: \"c5326e31-5f50-437e-9a58-c99c0be38f46\") " pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-kubelet-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-env-overrides\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-sysconfig\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.203178 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bd7c33b-667b-453f-9849-1f5ae785a3fc-tmp\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c86319d-26ad-4dc0-938c-2fc9e87a8945-hosts-file\") pod \"node-resolver-q2pvs\" (UID: \"3c86319d-26ad-4dc0-938c-2fc9e87a8945\") " pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdhx5\" (UniqueName: \"kubernetes.io/projected/3c86319d-26ad-4dc0-938c-2fc9e87a8945-kube-api-access-tdhx5\") pod \"node-resolver-q2pvs\" (UID: \"3c86319d-26ad-4dc0-938c-2fc9e87a8945\") " pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-kubelet\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-kubelet-dir\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200533 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9348038-f3b2-4684-a64a-147c84fc36d7-konnectivity-ca\") pod \"konnectivity-agent-mfrps\" (UID: \"c9348038-f3b2-4684-a64a-147c84fc36d7\") " pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-run-openvswitch\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c86319d-26ad-4dc0-938c-2fc9e87a8945-hosts-file\") pod \"node-resolver-q2pvs\" (UID: \"3c86319d-26ad-4dc0-938c-2fc9e87a8945\") " pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-daemon-config\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200673 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-etc-selinux\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200714 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-run-openvswitch\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-tuned\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200730 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-host-kubelet\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200722 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-env-overrides\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.200764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-sysconfig\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.203807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.201071 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6a89ca4-f4d4-4f04-99d2-85868a438513-etc-selinux\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.204545 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.201220 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b283adb-9daf-493b-82da-5fb2e92ff59b-multus-daemon-config\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.204545 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.202126 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-ovn-node-metrics-cert\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.204545 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.203058 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bd7c33b-667b-453f-9849-1f5ae785a3fc-tmp\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.204545 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.203169 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9348038-f3b2-4684-a64a-147c84fc36d7-agent-certs\") pod \"konnectivity-agent-mfrps\" (UID: \"c9348038-f3b2-4684-a64a-147c84fc36d7\") " pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:30:51.204545 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.203779 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bd7c33b-667b-453f-9849-1f5ae785a3fc-etc-tuned\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.207637 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.207570 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pn4d\" (UniqueName: \"kubernetes.io/projected/4bd7c33b-667b-453f-9849-1f5ae785a3fc-kube-api-access-5pn4d\") pod \"tuned-6hvrv\" (UID: \"4bd7c33b-667b-453f-9849-1f5ae785a3fc\") " pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.207759 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.207735 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mqvb\" (UniqueName: \"kubernetes.io/projected/3b283adb-9daf-493b-82da-5fb2e92ff59b-kube-api-access-4mqvb\") pod \"multus-mcx7k\" (UID: \"3b283adb-9daf-493b-82da-5fb2e92ff59b\") " pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.209148 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.209122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5jct\" (UniqueName: \"kubernetes.io/projected/7e00adee-1923-4395-b52a-dc1e1b6ea5e2-kube-api-access-p5jct\") pod \"ovnkube-node-76zkr\" (UID: \"7e00adee-1923-4395-b52a-dc1e1b6ea5e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.209260 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.209230 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmf59\" (UniqueName: \"kubernetes.io/projected/c6a89ca4-f4d4-4f04-99d2-85868a438513-kube-api-access-zmf59\") pod \"aws-ebs-csi-driver-node-92jk8\" (UID: \"c6a89ca4-f4d4-4f04-99d2-85868a438513\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.209545 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.209521 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzcqn\" (UniqueName: \"kubernetes.io/projected/7044dae5-8825-4d90-aab4-30b47b5600e2-kube-api-access-kzcqn\") pod \"multus-additional-cni-plugins-mnxct\" (UID: \"7044dae5-8825-4d90-aab4-30b47b5600e2\") " pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.210321 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.210299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprn7\" (UniqueName: \"kubernetes.io/projected/c5326e31-5f50-437e-9a58-c99c0be38f46-kube-api-access-fprn7\") pod \"iptables-alerter-8w8mm\" (UID: \"c5326e31-5f50-437e-9a58-c99c0be38f46\") " pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.213416 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.213391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdhx5\" (UniqueName: \"kubernetes.io/projected/3c86319d-26ad-4dc0-938c-2fc9e87a8945-kube-api-access-tdhx5\") pod \"node-resolver-q2pvs\" (UID: \"3c86319d-26ad-4dc0-938c-2fc9e87a8945\") " pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.293953 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.293864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2fjx" Jul 31 09:30:51.306017 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.305992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" Jul 31 09:30:51.322846 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.322821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q2pvs" Jul 31 09:30:51.329723 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.329703 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mnxct" Jul 31 09:30:51.337693 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.337670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:30:51.346670 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.346651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mcx7k" Jul 31 09:30:51.354441 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.354423 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:30:51.360872 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.360849 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 09:30:51.363974 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.363945 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8w8mm" Jul 31 09:30:51.368780 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.368763 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" Jul 31 09:30:51.604605 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.604549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:51.604778 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.604645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:51.604778 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.604737 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:51.604778 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.604754 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:51.604940 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.604811 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs podName:d83740ca-ebfe-45da-bee7-220b954c33d3 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:52.60479462 +0000 UTC m=+4.011324729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs") pod "network-metrics-daemon-9cbhc" (UID: "d83740ca-ebfe-45da-bee7-220b954c33d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:51.604940 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.604827 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret podName:11f6c97c-7d6f-4745-9d75-4a3577df3081 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:52.604820481 +0000 UTC m=+4.011350589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret") pod "global-pull-secret-syncer-9f5rs" (UID: "11f6c97c-7d6f-4745-9d75-4a3577df3081") : object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:51.705715 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:51.705678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:51.705882 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.705839 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 09:30:51.705882 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.705856 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 09:30:51.705882 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.705866 2578 projected.go:196] Error preparing data for projected volume kube-api-access-9xbx2 for pod openshift-network-diagnostics/network-check-target-z65mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:51.705996 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:51.705922 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2 podName:15756e9c-2f7b-453a-995f-e13c9bd0be46 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:52.705904919 +0000 UTC m=+4.112435050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9xbx2" (UniqueName: "kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2") pod "network-check-target-z65mq" (UID: "15756e9c-2f7b-453a-995f-e13c9bd0be46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:52.038231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:52.038105 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 09:25:51 +0000 UTC" deadline="2028-04-21 16:53:39.667588916 +0000 UTC" Jul 31 09:30:52.038231 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:52.038176 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15127h22m47.629417653s" Jul 31 09:30:52.084717 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:52.084638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:52.084878 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:52.084772 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:30:52.127371 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:52.127347 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd7c33b_667b_453f_9849_1f5ae785a3fc.slice/crio-e3c37e932489f7d8838862c48d2f354771bbbbff40fedac14a7db0f183884f86 WatchSource:0}: Error finding container e3c37e932489f7d8838862c48d2f354771bbbbff40fedac14a7db0f183884f86: Status 404 returned error can't find the container with id e3c37e932489f7d8838862c48d2f354771bbbbff40fedac14a7db0f183884f86 Jul 31 09:30:52.132106 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:52.132081 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b283adb_9daf_493b_82da_5fb2e92ff59b.slice/crio-ec9bbcc3b20cd34d7c3ae90c1232ed0d5b3f749f32fb31d4a697d15fb0b50ce5 WatchSource:0}: Error finding container ec9bbcc3b20cd34d7c3ae90c1232ed0d5b3f749f32fb31d4a697d15fb0b50ce5: Status 404 returned error can't find the container with id ec9bbcc3b20cd34d7c3ae90c1232ed0d5b3f749f32fb31d4a697d15fb0b50ce5 Jul 31 09:30:52.133721 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:52.133687 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7044dae5_8825_4d90_aab4_30b47b5600e2.slice/crio-76efaddf064d32da13332e0bbf1b923fd202a6c4fe05be747da15f41104982ee WatchSource:0}: Error finding container 76efaddf064d32da13332e0bbf1b923fd202a6c4fe05be747da15f41104982ee: Status 404 returned error can't find the container with id 76efaddf064d32da13332e0bbf1b923fd202a6c4fe05be747da15f41104982ee Jul 31 09:30:52.134716 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:52.134689 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c86319d_26ad_4dc0_938c_2fc9e87a8945.slice/crio-44da15cc115a77dc85d4fbd566ae859e1f01242c91f53d9973510e315fc282f0 WatchSource:0}: Error finding container 44da15cc115a77dc85d4fbd566ae859e1f01242c91f53d9973510e315fc282f0: Status 404 returned error can't find the container with id 44da15cc115a77dc85d4fbd566ae859e1f01242c91f53d9973510e315fc282f0 Jul 31 09:30:52.135427 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:52.135338 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9348038_f3b2_4684_a64a_147c84fc36d7.slice/crio-e64912ed652ef52b310ef7ea4cbed3926924040697bab91513be738a592f61a8 WatchSource:0}: Error finding container e64912ed652ef52b310ef7ea4cbed3926924040697bab91513be738a592f61a8: Status 404 returned error can't find the container with id e64912ed652ef52b310ef7ea4cbed3926924040697bab91513be738a592f61a8 Jul 31 09:30:52.136897 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:52.136773 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a89ca4_f4d4_4f04_99d2_85868a438513.slice/crio-fc5ac9ebf4079acd830570e12ebe4a9e4956d7b4721a0d6fbcfae9063455bc78 WatchSource:0}: Error finding container fc5ac9ebf4079acd830570e12ebe4a9e4956d7b4721a0d6fbcfae9063455bc78: Status 404 returned error can't find the container with id fc5ac9ebf4079acd830570e12ebe4a9e4956d7b4721a0d6fbcfae9063455bc78 Jul 31 09:30:52.159824 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:52.159789 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e00adee_1923_4395_b52a_dc1e1b6ea5e2.slice/crio-98c2e0e1e68310dd288a39e940673e05c2a1c7834b79fb0ce15819e9d1f9a1b6 WatchSource:0}: Error finding container 98c2e0e1e68310dd288a39e940673e05c2a1c7834b79fb0ce15819e9d1f9a1b6: Status 404 returned error can't find the container with id 98c2e0e1e68310dd288a39e940673e05c2a1c7834b79fb0ce15819e9d1f9a1b6 Jul 31 09:30:52.160727 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:52.160699 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5326e31_5f50_437e_9a58_c99c0be38f46.slice/crio-33cc0b41b5219061cdae95072590af13db69463968177526f4ebd89eb9f01da7 WatchSource:0}: Error finding container 33cc0b41b5219061cdae95072590af13db69463968177526f4ebd89eb9f01da7: Status 404 returned error can't find the container with id 33cc0b41b5219061cdae95072590af13db69463968177526f4ebd89eb9f01da7 Jul 31 09:30:52.161616 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:30:52.161588 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545bfd62_358c_4743_80df_242a578ecf2f.slice/crio-b6b1a69b10e5965ea2b3fe49be1d5b5689ceda6b85bc1036d428f49404e7e7d1 WatchSource:0}: Error finding container b6b1a69b10e5965ea2b3fe49be1d5b5689ceda6b85bc1036d428f49404e7e7d1: Status 404 returned error can't find the container with id b6b1a69b10e5965ea2b3fe49be1d5b5689ceda6b85bc1036d428f49404e7e7d1 Jul 31 09:30:52.612584 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:52.611917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:52.612584 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:52.612206 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:52.612584 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:52.612289 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret podName:11f6c97c-7d6f-4745-9d75-4a3577df3081 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:54.612266889 +0000 UTC m=+6.018797003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret") pod "global-pull-secret-syncer-9f5rs" (UID: "11f6c97c-7d6f-4745-9d75-4a3577df3081") : object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:52.612584 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:52.612338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:52.612584 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:52.612417 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:52.612584 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:52.612473 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs podName:d83740ca-ebfe-45da-bee7-220b954c33d3 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:54.612453977 +0000 UTC m=+6.018984090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs") pod "network-metrics-daemon-9cbhc" (UID: "d83740ca-ebfe-45da-bee7-220b954c33d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:52.713272 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:52.713212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:52.713460 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:52.713432 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 09:30:52.713460 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:52.713455 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 09:30:52.713604 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:52.713468 2578 projected.go:196] Error preparing data for projected volume kube-api-access-9xbx2 for pod openshift-network-diagnostics/network-check-target-z65mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:52.713604 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:52.713530 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2 podName:15756e9c-2f7b-453a-995f-e13c9bd0be46 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:54.713511153 +0000 UTC m=+6.120041265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9xbx2" (UniqueName: "kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2") pod "network-check-target-z65mq" (UID: "15756e9c-2f7b-453a-995f-e13c9bd0be46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:53.038768 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.038720 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 09:25:51 +0000 UTC" deadline="2028-03-28 21:49:02.634125825 +0000 UTC" Jul 31 09:30:53.038768 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.038765 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14556h18m9.595365516s" Jul 31 09:30:53.086687 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.086606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:53.086853 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:53.086759 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:30:53.087139 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.087118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:53.087243 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:53.087219 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:30:53.108505 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.108472 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" event={"ID":"7e00adee-1923-4395-b52a-dc1e1b6ea5e2","Type":"ContainerStarted","Data":"98c2e0e1e68310dd288a39e940673e05c2a1c7834b79fb0ce15819e9d1f9a1b6"} Jul 31 09:30:53.119361 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.119330 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnxct" event={"ID":"7044dae5-8825-4d90-aab4-30b47b5600e2","Type":"ContainerStarted","Data":"76efaddf064d32da13332e0bbf1b923fd202a6c4fe05be747da15f41104982ee"} Jul 31 09:30:53.124942 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.124884 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" event={"ID":"c6a89ca4-f4d4-4f04-99d2-85868a438513","Type":"ContainerStarted","Data":"fc5ac9ebf4079acd830570e12ebe4a9e4956d7b4721a0d6fbcfae9063455bc78"} Jul 31 09:30:53.127466 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.127241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mcx7k" event={"ID":"3b283adb-9daf-493b-82da-5fb2e92ff59b","Type":"ContainerStarted","Data":"ec9bbcc3b20cd34d7c3ae90c1232ed0d5b3f749f32fb31d4a697d15fb0b50ce5"} Jul 31 09:30:53.131042 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.131016 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q2pvs" event={"ID":"3c86319d-26ad-4dc0-938c-2fc9e87a8945","Type":"ContainerStarted","Data":"44da15cc115a77dc85d4fbd566ae859e1f01242c91f53d9973510e315fc282f0"} Jul 31 09:30:53.134132 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.134086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2fjx" event={"ID":"545bfd62-358c-4743-80df-242a578ecf2f","Type":"ContainerStarted","Data":"b6b1a69b10e5965ea2b3fe49be1d5b5689ceda6b85bc1036d428f49404e7e7d1"} Jul 31 09:30:53.151706 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.151673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mfrps" event={"ID":"c9348038-f3b2-4684-a64a-147c84fc36d7","Type":"ContainerStarted","Data":"e64912ed652ef52b310ef7ea4cbed3926924040697bab91513be738a592f61a8"} Jul 31 09:30:53.157866 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.157832 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" event={"ID":"4bd7c33b-667b-453f-9849-1f5ae785a3fc","Type":"ContainerStarted","Data":"e3c37e932489f7d8838862c48d2f354771bbbbff40fedac14a7db0f183884f86"} Jul 31 09:30:53.193677 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.192811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" event={"ID":"972297024dddeb976ba6e91301bc1a0d","Type":"ContainerStarted","Data":"897524ef51310220860c81468843b812295c71f6dba7d06d756c203218677128"} Jul 31 09:30:53.213131 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.213063 2578 generic.go:356] "Generic (PLEG): container finished" podID="ee672bbfd11f27c89b8358578ceac4a3" containerID="8b6b34b1e96ba465d882bdcccf5bdbfcae7c1db890ce463b9b695c21eda79d32" exitCode=0 Jul 31 09:30:53.213435 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.213366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" event={"ID":"ee672bbfd11f27c89b8358578ceac4a3","Type":"ContainerDied","Data":"8b6b34b1e96ba465d882bdcccf5bdbfcae7c1db890ce463b9b695c21eda79d32"} Jul 31 09:30:53.221242 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.221182 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" podStartSLOduration=2.221161022 podStartE2EDuration="2.221161022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:30:53.218902475 +0000 UTC m=+4.625432608" watchObservedRunningTime="2026-07-31 09:30:53.221161022 +0000 UTC m=+4.627691154" Jul 31 09:30:53.226275 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:53.224916 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8w8mm" event={"ID":"c5326e31-5f50-437e-9a58-c99c0be38f46","Type":"ContainerStarted","Data":"33cc0b41b5219061cdae95072590af13db69463968177526f4ebd89eb9f01da7"} Jul 31 09:30:54.084728 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:54.084684 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:54.085217 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:54.084831 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:30:54.260246 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:54.260212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" event={"ID":"ee672bbfd11f27c89b8358578ceac4a3","Type":"ContainerStarted","Data":"3b01bff9a7d2dd6c8f72ea24d107813254d8975f0b29b80c88c88beccb0d185d"} Jul 31 09:30:54.630410 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:54.630376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:54.630592 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:54.630443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:54.630592 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:54.630569 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:54.630797 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:54.630649 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs podName:d83740ca-ebfe-45da-bee7-220b954c33d3 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:58.630630099 +0000 UTC m=+10.037160247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs") pod "network-metrics-daemon-9cbhc" (UID: "d83740ca-ebfe-45da-bee7-220b954c33d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:54.631062 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:54.631043 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:54.631136 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:54.631123 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret podName:11f6c97c-7d6f-4745-9d75-4a3577df3081 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:58.631087503 +0000 UTC m=+10.037617614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret") pod "global-pull-secret-syncer-9f5rs" (UID: "11f6c97c-7d6f-4745-9d75-4a3577df3081") : object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:54.731453 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:54.731412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:54.731678 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:54.731653 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 09:30:54.731678 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:54.731676 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 09:30:54.731794 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:54.731690 2578 projected.go:196] Error preparing data for projected volume kube-api-access-9xbx2 for pod openshift-network-diagnostics/network-check-target-z65mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:54.731794 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:54.731751 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2 podName:15756e9c-2f7b-453a-995f-e13c9bd0be46 nodeName:}" failed. No retries permitted until 2026-07-31 09:30:58.73173269 +0000 UTC m=+10.138262801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9xbx2" (UniqueName: "kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2") pod "network-check-target-z65mq" (UID: "15756e9c-2f7b-453a-995f-e13c9bd0be46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:55.087376 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:55.087287 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:55.087883 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:55.087451 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:30:55.087883 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:55.087533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:55.087883 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:55.087608 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:30:56.084606 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:56.084538 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:56.084796 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:56.084691 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:30:57.084107 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:57.084078 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:57.084510 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:57.084221 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:30:57.085240 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:57.084037 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:57.085386 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:57.085357 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:30:58.084180 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:58.084094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:58.084614 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:58.084305 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:30:58.665506 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:58.665470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:58.665717 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:58.665528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:58.665717 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:58.665661 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:58.665843 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:58.665726 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs podName:d83740ca-ebfe-45da-bee7-220b954c33d3 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:06.665707163 +0000 UTC m=+18.072237275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs") pod "network-metrics-daemon-9cbhc" (UID: "d83740ca-ebfe-45da-bee7-220b954c33d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:30:58.665843 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:58.665793 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:58.665843 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:58.665834 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret podName:11f6c97c-7d6f-4745-9d75-4a3577df3081 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:06.665822457 +0000 UTC m=+18.072352568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret") pod "global-pull-secret-syncer-9f5rs" (UID: "11f6c97c-7d6f-4745-9d75-4a3577df3081") : object "kube-system"/"original-pull-secret" not registered Jul 31 09:30:58.767054 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:58.766454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:30:58.767054 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:58.766699 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 09:30:58.767054 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:58.766725 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 09:30:58.767054 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:58.766739 2578 projected.go:196] Error preparing data for projected volume kube-api-access-9xbx2 for pod openshift-network-diagnostics/network-check-target-z65mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:58.767054 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:58.766803 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2 podName:15756e9c-2f7b-453a-995f-e13c9bd0be46 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:06.766783629 +0000 UTC m=+18.173313744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9xbx2" (UniqueName: "kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2") pod "network-check-target-z65mq" (UID: "15756e9c-2f7b-453a-995f-e13c9bd0be46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:30:59.085639 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:59.085544 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:30:59.086048 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:59.085688 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:30:59.086130 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:30:59.086079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:30:59.086191 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:30:59.086174 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:00.084930 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:00.084892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:00.085173 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:00.085034 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:01.084652 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:01.084567 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:01.084652 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:01.084592 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:01.085198 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:01.084731 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:01.085198 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:01.084841 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:02.084001 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:02.083963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:02.084183 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:02.084090 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:03.084949 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:03.084911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:03.084949 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:03.084951 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:03.085320 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:03.085051 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:03.085320 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:03.085163 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:04.084141 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:04.084074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:04.084281 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:04.084168 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:05.084629 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:05.084596 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:05.085063 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:05.084596 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:05.085063 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:05.084741 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:05.085063 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:05.084805 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:06.084009 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:06.083979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:06.084265 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:06.084083 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:06.725163 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:06.725128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:06.725644 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:06.725198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:06.725644 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:06.725300 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:31:06.725644 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:06.725368 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs podName:d83740ca-ebfe-45da-bee7-220b954c33d3 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:22.725350893 +0000 UTC m=+34.131881000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs") pod "network-metrics-daemon-9cbhc" (UID: "d83740ca-ebfe-45da-bee7-220b954c33d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:31:06.725644 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:06.725301 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 09:31:06.725644 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:06.725414 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret podName:11f6c97c-7d6f-4745-9d75-4a3577df3081 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:22.725404062 +0000 UTC m=+34.131934171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret") pod "global-pull-secret-syncer-9f5rs" (UID: "11f6c97c-7d6f-4745-9d75-4a3577df3081") : object "kube-system"/"original-pull-secret" not registered Jul 31 09:31:06.826157 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:06.826125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:06.826377 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:06.826289 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 09:31:06.826377 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:06.826309 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 09:31:06.826377 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:06.826323 2578 projected.go:196] Error preparing data for projected volume kube-api-access-9xbx2 for pod openshift-network-diagnostics/network-check-target-z65mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:31:06.826377 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:06.826378 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2 podName:15756e9c-2f7b-453a-995f-e13c9bd0be46 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:22.826361375 +0000 UTC m=+34.232891485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9xbx2" (UniqueName: "kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2") pod "network-check-target-z65mq" (UID: "15756e9c-2f7b-453a-995f-e13c9bd0be46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:31:07.084917 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:07.084824 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:07.085084 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:07.084841 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:07.085084 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:07.084959 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:07.085084 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:07.085021 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:08.084365 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:08.084335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:08.084852 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:08.084451 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:09.085441 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:09.085410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:09.085848 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:09.085532 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:09.085848 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:09.085598 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:09.085848 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:09.085698 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:10.084044 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:10.084011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:10.084222 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:10.084112 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:11.084074 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:11.084038 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:11.084525 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:11.084168 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:11.084525 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:11.084201 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:11.084525 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:11.084264 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:12.085214 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.084860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:12.086085 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:12.085346 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:12.334164 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.334133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mcx7k" event={"ID":"3b283adb-9daf-493b-82da-5fb2e92ff59b","Type":"ContainerStarted","Data":"fecc54c2d648c7adaf49f0a4c88e000b663078792dd5e10cca91efe5e20d9162"} Jul 31 09:31:12.335486 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.335463 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q2pvs" event={"ID":"3c86319d-26ad-4dc0-938c-2fc9e87a8945","Type":"ContainerStarted","Data":"58eb17e95df387e8ebe4f95cdf07ecbc87f8027a17b0a2d073612fe6221f3399"} Jul 31 09:31:12.336883 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.336863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2fjx" event={"ID":"545bfd62-358c-4743-80df-242a578ecf2f","Type":"ContainerStarted","Data":"0d539b2722324a538f7d9bebb3bd8d091f42baf8ececd457816f92f79a4a626d"} Jul 31 09:31:12.338061 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.338042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mfrps" event={"ID":"c9348038-f3b2-4684-a64a-147c84fc36d7","Type":"ContainerStarted","Data":"4cc0e7d80e9fc466f1e32b1caebacf786d1b263733bf5a93e2f979656a5ede0e"} Jul 31 09:31:12.339343 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.339318 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" event={"ID":"4bd7c33b-667b-453f-9849-1f5ae785a3fc","Type":"ContainerStarted","Data":"942723f538fc12fccac93689a49d96a124cbb3eaf4b2c57211e61108fb73801a"} Jul 31 09:31:12.341775 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.341758 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" event={"ID":"7e00adee-1923-4395-b52a-dc1e1b6ea5e2","Type":"ContainerStarted","Data":"d35e72bb9b0177db0d9839b751322ea97ba2b49fa512f46ba53ae495ba3a9d2d"} Jul 31 09:31:12.341873 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.341806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" event={"ID":"7e00adee-1923-4395-b52a-dc1e1b6ea5e2","Type":"ContainerStarted","Data":"9f9fd151ac35e19d9e3334eaa7125e220d7e700c7cb11c0920f9733a3dd24a2d"} Jul 31 09:31:12.341873 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.341836 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" event={"ID":"7e00adee-1923-4395-b52a-dc1e1b6ea5e2","Type":"ContainerStarted","Data":"746183d7c812d946a566e01511cbc251b73953582b608451d5b0aae675c54d37"} Jul 31 09:31:12.341957 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.341868 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" event={"ID":"7e00adee-1923-4395-b52a-dc1e1b6ea5e2","Type":"ContainerStarted","Data":"661eac5764caed964a3a201e396e7ce1051dc975398e91a4d7a411c3b356485e"} Jul 31 09:31:12.341957 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.341927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" event={"ID":"7e00adee-1923-4395-b52a-dc1e1b6ea5e2","Type":"ContainerStarted","Data":"9de2868e0be77ea7d59aff637bc5cdb6056053dc249d2129c55b93bdb2cc6c63"} Jul 31 09:31:12.342050 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.341991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" event={"ID":"7e00adee-1923-4395-b52a-dc1e1b6ea5e2","Type":"ContainerStarted","Data":"9797a98a235f33261cb52cceb9684cb08ff779dff14ba8337b3e34f7acc16403"} Jul 31 09:31:12.343115 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.343098 2578 generic.go:356] "Generic (PLEG): container finished" podID="7044dae5-8825-4d90-aab4-30b47b5600e2" containerID="d209dacbc2f5c8735052826cd61d10375b97c549fdc86baf0b2efab204425c71" exitCode=0 Jul 31 09:31:12.343176 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.343153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnxct" event={"ID":"7044dae5-8825-4d90-aab4-30b47b5600e2","Type":"ContainerDied","Data":"d209dacbc2f5c8735052826cd61d10375b97c549fdc86baf0b2efab204425c71"} Jul 31 09:31:12.344437 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.344380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" event={"ID":"c6a89ca4-f4d4-4f04-99d2-85868a438513","Type":"ContainerStarted","Data":"314c6918522b403bfd05f17043bac72666e900fc0e075fcdc158c96837158c4d"} Jul 31 09:31:12.355112 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.355053 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" podStartSLOduration=21.355024917 podStartE2EDuration="21.355024917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:30:54.280805408 +0000 UTC m=+5.687335541" watchObservedRunningTime="2026-07-31 09:31:12.355024917 +0000 UTC m=+23.761555023" Jul 31 09:31:12.372846 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.372809 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mcx7k" podStartSLOduration=3.227422521 podStartE2EDuration="22.372798067s" totalImagesPullingTime="19.145375546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:12.355769646 +0000 UTC m=+23.762299774" watchObservedRunningTime="2026-07-31 09:31:12.372798067 +0000 UTC m=+23.779328195" Jul 31 09:31:12.390846 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.390814 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mfrps" podStartSLOduration=3.355996456 podStartE2EDuration="22.390805746s" totalImagesPullingTime="19.03480929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:12.372739727 +0000 UTC m=+23.779269856" watchObservedRunningTime="2026-07-31 09:31:12.390805746 +0000 UTC m=+23.797335857" Jul 31 09:31:12.390943 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.390919 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6hvrv" podStartSLOduration=3.283336295 podStartE2EDuration="22.390913132s" totalImagesPullingTime="19.107576837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:12.390802347 +0000 UTC m=+23.797332467" watchObservedRunningTime="2026-07-31 09:31:12.390913132 +0000 UTC m=+23.797443261" Jul 31 09:31:12.411010 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.410973 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m2fjx" podStartSLOduration=3.362609209 podStartE2EDuration="22.410961431s" totalImagesPullingTime="19.048352222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:12.410788994 +0000 UTC m=+23.817319123" watchObservedRunningTime="2026-07-31 09:31:12.410961431 +0000 UTC m=+23.817491559" Jul 31 09:31:12.454628 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.454587 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q2pvs" podStartSLOduration=3.398797192 podStartE2EDuration="22.454573795s" totalImagesPullingTime="19.055776603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:12.429126707 +0000 UTC m=+23.835656834" watchObservedRunningTime="2026-07-31 09:31:12.454573795 +0000 UTC m=+23.861103923" Jul 31 09:31:12.700842 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:12.700816 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 31 09:31:13.060341 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:13.060210 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T09:31:12.700833332Z","UUID":"9a5ad8f4-907b-4445-a9c5-41363dd95f35","Handler":null,"Name":"","Endpoint":""} Jul 31 09:31:13.062014 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:13.061992 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 31 09:31:13.062131 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:13.062035 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 31 09:31:13.084641 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:13.084614 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:13.084641 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:13.084619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:13.084801 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:13.084753 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:13.084932 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:13.084892 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:13.348266 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:13.348229 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8w8mm" event={"ID":"c5326e31-5f50-437e-9a58-c99c0be38f46","Type":"ContainerStarted","Data":"c80e2d076b382de9ae688a2243e4c49bc40d24d94fcd6b608cf0bb06764572f3"} Jul 31 09:31:13.354691 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:13.354654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" event={"ID":"c6a89ca4-f4d4-4f04-99d2-85868a438513","Type":"ContainerStarted","Data":"075b78ec341b0f0a06f5b1113e98f19d34723813ad50f423c8d21ba35f9c66ea"} Jul 31 09:31:14.084442 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:14.084417 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:14.084694 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:14.084530 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:14.360659 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:14.360627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" event={"ID":"7e00adee-1923-4395-b52a-dc1e1b6ea5e2","Type":"ContainerStarted","Data":"10fd5d69689370eb6ef6ab089ffa6a36575f105ba8518c92a2361454ca3c8665"} Jul 31 09:31:14.362951 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:14.362927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" event={"ID":"c6a89ca4-f4d4-4f04-99d2-85868a438513","Type":"ContainerStarted","Data":"bc95490da269ef42c31979d03ef0b7da177e35ec6ef855f2ccd669c730030d98"} Jul 31 09:31:14.382532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:14.382488 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-92jk8" podStartSLOduration=3.130045232 podStartE2EDuration="24.382473392s" totalImagesPullingTime="21.25242816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:14.382214517 +0000 UTC m=+25.788744660" watchObservedRunningTime="2026-07-31 09:31:14.382473392 +0000 UTC m=+25.789003522" Jul 31 09:31:14.382714 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:14.382686 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8w8mm" podStartSLOduration=5.325664019 podStartE2EDuration="24.382678145s" totalImagesPullingTime="19.057014126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:13.365698017 +0000 UTC m=+24.772228144" watchObservedRunningTime="2026-07-31 09:31:14.382678145 +0000 UTC m=+25.789208280" Jul 31 09:31:14.746408 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:14.746337 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:31:14.746965 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:14.746950 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:31:15.085131 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:15.085055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:15.085290 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:15.085188 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:15.085290 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:15.085218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:15.085402 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:15.085328 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:15.365342 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:15.365311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:31:15.365830 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:15.365692 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mfrps" Jul 31 09:31:16.085177 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:16.084975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:16.085356 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:16.085279 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:16.375804 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:16.375665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" event={"ID":"7e00adee-1923-4395-b52a-dc1e1b6ea5e2","Type":"ContainerStarted","Data":"0140187af6c3f1096c7148eea5bdbf099869e82c317835227b8211bee7706be1"} Jul 31 09:31:16.376836 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:16.375909 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:31:16.376836 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:16.375982 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:31:16.376836 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:16.376131 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:31:16.392985 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:16.392965 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:31:16.398905 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:16.398888 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:31:16.409761 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:16.409717 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" podStartSLOduration=7.276038839 podStartE2EDuration="26.409697847s" totalImagesPullingTime="19.133659008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:16.409009232 +0000 UTC m=+27.815539360" watchObservedRunningTime="2026-07-31 09:31:16.409697847 +0000 UTC m=+27.816227976" Jul 31 09:31:17.084238 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:17.084208 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:17.084238 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:17.084228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:17.084481 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:17.084309 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:17.084481 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:17.084429 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:17.379409 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:17.379376 2578 generic.go:356] "Generic (PLEG): container finished" podID="7044dae5-8825-4d90-aab4-30b47b5600e2" containerID="12c1f5b08aba7ead82f05fc658f8f5c4f09a8018e3cebb8b1e9ee2eb691fd311" exitCode=0 Jul 31 09:31:17.380008 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:17.379470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnxct" event={"ID":"7044dae5-8825-4d90-aab4-30b47b5600e2","Type":"ContainerDied","Data":"12c1f5b08aba7ead82f05fc658f8f5c4f09a8018e3cebb8b1e9ee2eb691fd311"} Jul 31 09:31:18.084942 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:18.084636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:18.084942 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:18.084896 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:18.319256 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:18.319234 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9f5rs"] Jul 31 09:31:18.319353 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:18.319341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:18.319450 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:18.319425 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:18.328155 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:18.327954 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9cbhc"] Jul 31 09:31:18.328155 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:18.328053 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z65mq"] Jul 31 09:31:18.328155 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:18.328144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:18.328352 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:18.328257 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:18.381843 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:18.381815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:18.382199 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:18.381920 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:19.386374 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:19.386334 2578 generic.go:356] "Generic (PLEG): container finished" podID="7044dae5-8825-4d90-aab4-30b47b5600e2" containerID="6a6f3e193fb11e215a5a05f56452d4cb0bc36e97470407d991d8f90bd18538d1" exitCode=0 Jul 31 09:31:19.386772 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:19.386389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnxct" event={"ID":"7044dae5-8825-4d90-aab4-30b47b5600e2","Type":"ContainerDied","Data":"6a6f3e193fb11e215a5a05f56452d4cb0bc36e97470407d991d8f90bd18538d1"} Jul 31 09:31:20.084848 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:20.084814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:20.084848 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:20.084848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:20.085081 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:20.084912 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:20.085081 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:20.084926 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:20.085081 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:20.084976 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:20.085081 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:20.085059 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:21.393044 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:21.392862 2578 generic.go:356] "Generic (PLEG): container finished" podID="7044dae5-8825-4d90-aab4-30b47b5600e2" containerID="d391f6b2d503765fa880a94365f6b67edc8ccc361f41a243f8c6b5370a8dec5d" exitCode=0 Jul 31 09:31:21.393044 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:21.392950 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnxct" event={"ID":"7044dae5-8825-4d90-aab4-30b47b5600e2","Type":"ContainerDied","Data":"d391f6b2d503765fa880a94365f6b67edc8ccc361f41a243f8c6b5370a8dec5d"} Jul 31 09:31:22.084147 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:22.084118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:22.084320 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:22.084118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:22.084320 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.084220 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:22.084430 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.084328 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:22.084430 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:22.084118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:22.084520 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.084464 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:22.743229 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:22.743192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:22.743696 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:22.743265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:22.743696 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.743356 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 09:31:22.743696 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.743399 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:31:22.743696 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.743439 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret podName:11f6c97c-7d6f-4745-9d75-4a3577df3081 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:54.743417197 +0000 UTC m=+66.149947307 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret") pod "global-pull-secret-syncer-9f5rs" (UID: "11f6c97c-7d6f-4745-9d75-4a3577df3081") : object "kube-system"/"original-pull-secret" not registered Jul 31 09:31:22.743696 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.743458 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs podName:d83740ca-ebfe-45da-bee7-220b954c33d3 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:54.743448633 +0000 UTC m=+66.149978745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs") pod "network-metrics-daemon-9cbhc" (UID: "d83740ca-ebfe-45da-bee7-220b954c33d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 09:31:22.844145 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:22.844103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:22.844370 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.844241 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 09:31:22.844370 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.844262 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 09:31:22.844370 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.844272 2578 projected.go:196] Error preparing data for projected volume kube-api-access-9xbx2 for pod openshift-network-diagnostics/network-check-target-z65mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:31:22.844370 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:22.844328 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2 podName:15756e9c-2f7b-453a-995f-e13c9bd0be46 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:54.844313337 +0000 UTC m=+66.250843448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9xbx2" (UniqueName: "kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2") pod "network-check-target-z65mq" (UID: "15756e9c-2f7b-453a-995f-e13c9bd0be46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 09:31:24.084858 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.084826 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:24.085384 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.084861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:24.085384 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:24.084942 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f5rs" podUID="11f6c97c-7d6f-4745-9d75-4a3577df3081" Jul 31 09:31:24.085384 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.084984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:24.085384 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:24.085058 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z65mq" podUID="15756e9c-2f7b-453a-995f-e13c9bd0be46" Jul 31 09:31:24.085384 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:24.085137 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9cbhc" podUID="d83740ca-ebfe-45da-bee7-220b954c33d3" Jul 31 09:31:24.877652 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.877614 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeReady" Jul 31 09:31:24.877804 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.877768 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 31 09:31:24.948393 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.948363 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rwtww"] Jul 31 09:31:24.953254 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.953227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:24.953488 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.953469 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nlqnw"] Jul 31 09:31:24.955917 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.955762 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 31 09:31:24.955917 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.955789 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 31 09:31:24.956128 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.956107 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2x7rl\"" Jul 31 09:31:24.956650 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.956634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nlqnw" Jul 31 09:31:24.959956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.959753 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 31 09:31:24.959956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.959841 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 31 09:31:24.959956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.959865 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cdt2n\"" Jul 31 09:31:24.959956 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.959761 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 31 09:31:24.963502 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.963480 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwtww"] Jul 31 09:31:24.980204 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:24.980181 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nlqnw"] Jul 31 09:31:25.061157 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.061127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8e861e1-de09-4478-b1cb-d4f2ff552c80-config-volume\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.061157 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.061159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c958ada3-666d-4ff7-be9c-a827dbcdb66c-cert\") pod \"ingress-canary-nlqnw\" (UID: \"c958ada3-666d-4ff7-be9c-a827dbcdb66c\") " pod="openshift-ingress-canary/ingress-canary-nlqnw" Jul 31 09:31:25.061395 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.061263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zd6n\" (UniqueName: \"kubernetes.io/projected/c8e861e1-de09-4478-b1cb-d4f2ff552c80-kube-api-access-7zd6n\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.061395 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.061310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4smq\" (UniqueName: \"kubernetes.io/projected/c958ada3-666d-4ff7-be9c-a827dbcdb66c-kube-api-access-g4smq\") pod \"ingress-canary-nlqnw\" (UID: \"c958ada3-666d-4ff7-be9c-a827dbcdb66c\") " pod="openshift-ingress-canary/ingress-canary-nlqnw" Jul 31 09:31:25.061395 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.061337 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.061395 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.061370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8e861e1-de09-4478-b1cb-d4f2ff552c80-tmp-dir\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.161919 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.161886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8e861e1-de09-4478-b1cb-d4f2ff552c80-config-volume\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.161919 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.161927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c958ada3-666d-4ff7-be9c-a827dbcdb66c-cert\") pod \"ingress-canary-nlqnw\" (UID: \"c958ada3-666d-4ff7-be9c-a827dbcdb66c\") " pod="openshift-ingress-canary/ingress-canary-nlqnw" Jul 31 09:31:25.162516 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.161996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zd6n\" (UniqueName: \"kubernetes.io/projected/c8e861e1-de09-4478-b1cb-d4f2ff552c80-kube-api-access-7zd6n\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.162516 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.162024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4smq\" (UniqueName: \"kubernetes.io/projected/c958ada3-666d-4ff7-be9c-a827dbcdb66c-kube-api-access-g4smq\") pod \"ingress-canary-nlqnw\" (UID: \"c958ada3-666d-4ff7-be9c-a827dbcdb66c\") " pod="openshift-ingress-canary/ingress-canary-nlqnw" Jul 31 09:31:25.162516 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.162045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.162516 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.162073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8e861e1-de09-4478-b1cb-d4f2ff552c80-tmp-dir\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.162516 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:25.162290 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 09:31:25.162516 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:25.162362 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls podName:c8e861e1-de09-4478-b1cb-d4f2ff552c80 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:25.662340607 +0000 UTC m=+37.068870729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls") pod "dns-default-rwtww" (UID: "c8e861e1-de09-4478-b1cb-d4f2ff552c80") : secret "dns-default-metrics-tls" not found Jul 31 09:31:25.162516 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.162412 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8e861e1-de09-4478-b1cb-d4f2ff552c80-tmp-dir\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.162815 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.162690 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8e861e1-de09-4478-b1cb-d4f2ff552c80-config-volume\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.166520 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.166500 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c958ada3-666d-4ff7-be9c-a827dbcdb66c-cert\") pod \"ingress-canary-nlqnw\" (UID: \"c958ada3-666d-4ff7-be9c-a827dbcdb66c\") " pod="openshift-ingress-canary/ingress-canary-nlqnw" Jul 31 09:31:25.170895 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.170861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zd6n\" (UniqueName: \"kubernetes.io/projected/c8e861e1-de09-4478-b1cb-d4f2ff552c80-kube-api-access-7zd6n\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.171085 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.171052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4smq\" (UniqueName: \"kubernetes.io/projected/c958ada3-666d-4ff7-be9c-a827dbcdb66c-kube-api-access-g4smq\") pod \"ingress-canary-nlqnw\" (UID: \"c958ada3-666d-4ff7-be9c-a827dbcdb66c\") " pod="openshift-ingress-canary/ingress-canary-nlqnw" Jul 31 09:31:25.272166 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.272084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nlqnw" Jul 31 09:31:25.519961 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.519816 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nlqnw"] Jul 31 09:31:25.523391 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:25.523371 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc958ada3_666d_4ff7_be9c_a827dbcdb66c.slice/crio-a7e0adcb20f274b1481e6b9586b6e90c0a359c6bc6e5255b730f3c00490e36b6 WatchSource:0}: Error finding container a7e0adcb20f274b1481e6b9586b6e90c0a359c6bc6e5255b730f3c00490e36b6: Status 404 returned error can't find the container with id a7e0adcb20f274b1481e6b9586b6e90c0a359c6bc6e5255b730f3c00490e36b6 Jul 31 09:31:25.665242 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:25.665214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:25.665388 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:25.665370 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 09:31:25.665443 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:25.665432 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls podName:c8e861e1-de09-4478-b1cb-d4f2ff552c80 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:26.665417615 +0000 UTC m=+38.071947722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls") pod "dns-default-rwtww" (UID: "c8e861e1-de09-4478-b1cb-d4f2ff552c80") : secret "dns-default-metrics-tls" not found Jul 31 09:31:26.078119 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.078081 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h"] Jul 31 09:31:26.081332 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.081311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h" Jul 31 09:31:26.084476 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.084425 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 31 09:31:26.084476 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.084433 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:26.084476 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.084461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:26.084476 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.084469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:26.085616 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.085597 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kwlnq\"" Jul 31 09:31:26.085616 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.085615 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 31 09:31:26.087665 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.087646 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 09:31:26.087780 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.087754 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 09:31:26.088855 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.088412 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-25l5h\"" Jul 31 09:31:26.088855 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.088430 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nfbq9\"" Jul 31 09:31:26.088855 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.088461 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 09:31:26.088855 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.088417 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 09:31:26.091999 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.091952 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h"] Jul 31 09:31:26.167692 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.167661 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94"] Jul 31 09:31:26.169030 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.169000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsq92\" (UniqueName: \"kubernetes.io/projected/65579c9a-757e-4c90-be4c-cb3abecaca61-kube-api-access-vsq92\") pod \"volume-data-source-validator-5b8776669-82f2h\" (UID: \"65579c9a-757e-4c90-be4c-cb3abecaca61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h" Jul 31 09:31:26.171276 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.171222 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:26.176424 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.176403 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 31 09:31:26.176563 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.176486 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 31 09:31:26.176887 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.176864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q2sgt\"" Jul 31 09:31:26.176887 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.176880 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 31 09:31:26.191656 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.191623 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94"] Jul 31 09:31:26.270076 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.270039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v75rc\" (UniqueName: \"kubernetes.io/projected/2e46b23c-d483-4de5-9f09-391172dc8114-kube-api-access-v75rc\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:26.270266 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.270249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsq92\" (UniqueName: \"kubernetes.io/projected/65579c9a-757e-4c90-be4c-cb3abecaca61-kube-api-access-vsq92\") pod \"volume-data-source-validator-5b8776669-82f2h\" (UID: \"65579c9a-757e-4c90-be4c-cb3abecaca61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h" Jul 31 09:31:26.270328 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.270286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:26.274254 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.274231 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d9c9ddb47-qfnvl"] Jul 31 09:31:26.277681 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.277662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.284571 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.284534 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsq92\" (UniqueName: \"kubernetes.io/projected/65579c9a-757e-4c90-be4c-cb3abecaca61-kube-api-access-vsq92\") pod \"volume-data-source-validator-5b8776669-82f2h\" (UID: \"65579c9a-757e-4c90-be4c-cb3abecaca61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h" Jul 31 09:31:26.285186 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.285159 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 31 09:31:26.285421 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.285403 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 31 09:31:26.286953 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.286797 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 31 09:31:26.289370 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.289352 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vcvff\"" Jul 31 09:31:26.305907 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.305889 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 31 09:31:26.366596 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.366566 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d9c9ddb47-qfnvl"] Jul 31 09:31:26.370778 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.370592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v75rc\" (UniqueName: \"kubernetes.io/projected/2e46b23c-d483-4de5-9f09-391172dc8114-kube-api-access-v75rc\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:26.370778 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.370632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-bound-sa-token\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.370778 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.370749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.371012 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.370796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-certificates\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.371012 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.370855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-image-registry-private-configuration\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.371012 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.370889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:26.371012 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.370944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7kt9\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-kube-api-access-q7kt9\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.371012 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.370990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-trusted-ca\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.371012 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.371014 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 09:31:26.371259 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.371073 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls podName:2e46b23c-d483-4de5-9f09-391172dc8114 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:26.871054972 +0000 UTC m=+38.277585078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zrd94" (UID: "2e46b23c-d483-4de5-9f09-391172dc8114") : secret "samples-operator-tls" not found Jul 31 09:31:26.371259 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.371098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-installation-pull-secrets\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.371259 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.371122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-ca-trust-extracted\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.391456 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.391406 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v75rc\" (UniqueName: \"kubernetes.io/projected/2e46b23c-d483-4de5-9f09-391172dc8114-kube-api-access-v75rc\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:26.393119 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.393091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h" Jul 31 09:31:26.409104 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.408998 2578 generic.go:356] "Generic (PLEG): container finished" podID="7044dae5-8825-4d90-aab4-30b47b5600e2" containerID="400128f6ffa846aadc215e451de74e1f6ee0854be1e3d7d04e2066a9a00b1157" exitCode=0 Jul 31 09:31:26.409104 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.409087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnxct" event={"ID":"7044dae5-8825-4d90-aab4-30b47b5600e2","Type":"ContainerDied","Data":"400128f6ffa846aadc215e451de74e1f6ee0854be1e3d7d04e2066a9a00b1157"} Jul 31 09:31:26.411177 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.411127 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nlqnw" event={"ID":"c958ada3-666d-4ff7-be9c-a827dbcdb66c","Type":"ContainerStarted","Data":"a7e0adcb20f274b1481e6b9586b6e90c0a359c6bc6e5255b730f3c00490e36b6"} Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.475480 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-installation-pull-secrets\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.475527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-ca-trust-extracted\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.475577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-bound-sa-token\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.475663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.475685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-certificates\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.475715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-image-registry-private-configuration\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.475754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7kt9\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-kube-api-access-q7kt9\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.475780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-trusted-ca\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.476859 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.476887 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9c9ddb47-qfnvl: secret "image-registry-tls" not found Jul 31 09:31:26.477002 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.476953 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls podName:da10bd2c-f001-4d3e-8b1d-ebaa223a9485 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:26.976930387 +0000 UTC m=+38.383460496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls") pod "image-registry-5d9c9ddb47-qfnvl" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485") : secret "image-registry-tls" not found Jul 31 09:31:26.478353 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.477266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-trusted-ca\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.478353 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.477272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-ca-trust-extracted\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.478473 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.478361 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-certificates\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.482914 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.482883 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-image-registry-private-configuration\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.483879 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.483836 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-installation-pull-secrets\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.496485 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.496430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7kt9\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-kube-api-access-q7kt9\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.497029 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.496990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-bound-sa-token\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.564874 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.564808 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h"] Jul 31 09:31:26.605576 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:26.605372 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65579c9a_757e_4c90_be4c_cb3abecaca61.slice/crio-210473a50572702202808148ddb1993ce7cb0b7c865ad98c7d317fcf7f2f71d4 WatchSource:0}: Error finding container 210473a50572702202808148ddb1993ce7cb0b7c865ad98c7d317fcf7f2f71d4: Status 404 returned error can't find the container with id 210473a50572702202808148ddb1993ce7cb0b7c865ad98c7d317fcf7f2f71d4 Jul 31 09:31:26.677372 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.677296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:26.677525 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.677506 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 09:31:26.677602 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.677593 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls podName:c8e861e1-de09-4478-b1cb-d4f2ff552c80 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:28.677572965 +0000 UTC m=+40.084103091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls") pod "dns-default-rwtww" (UID: "c8e861e1-de09-4478-b1cb-d4f2ff552c80") : secret "dns-default-metrics-tls" not found Jul 31 09:31:26.879244 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.879210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:26.879391 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.879348 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 09:31:26.879435 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.879411 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls podName:2e46b23c-d483-4de5-9f09-391172dc8114 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:27.879395122 +0000 UTC m=+39.285925229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zrd94" (UID: "2e46b23c-d483-4de5-9f09-391172dc8114") : secret "samples-operator-tls" not found Jul 31 09:31:26.980738 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.980655 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 09:31:26.980919 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:26.980501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:26.983918 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.980989 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9c9ddb47-qfnvl: secret "image-registry-tls" not found Jul 31 09:31:26.983918 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:26.981085 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls podName:da10bd2c-f001-4d3e-8b1d-ebaa223a9485 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:27.981052236 +0000 UTC m=+39.387582343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls") pod "image-registry-5d9c9ddb47-qfnvl" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485") : secret "image-registry-tls" not found Jul 31 09:31:27.414967 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:27.414925 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h" event={"ID":"65579c9a-757e-4c90-be4c-cb3abecaca61","Type":"ContainerStarted","Data":"210473a50572702202808148ddb1993ce7cb0b7c865ad98c7d317fcf7f2f71d4"} Jul 31 09:31:27.419471 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:27.419442 2578 generic.go:356] "Generic (PLEG): container finished" podID="7044dae5-8825-4d90-aab4-30b47b5600e2" containerID="774f2081d5ee638a78483cfd96c91346ec728c8bfd7b32e7024e69b1e37669ce" exitCode=0 Jul 31 09:31:27.419637 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:27.419494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnxct" event={"ID":"7044dae5-8825-4d90-aab4-30b47b5600e2","Type":"ContainerDied","Data":"774f2081d5ee638a78483cfd96c91346ec728c8bfd7b32e7024e69b1e37669ce"} Jul 31 09:31:27.888822 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:27.888796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:27.888964 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:27.888945 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 09:31:27.889016 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:27.889007 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls podName:2e46b23c-d483-4de5-9f09-391172dc8114 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:29.888992695 +0000 UTC m=+41.295522802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zrd94" (UID: "2e46b23c-d483-4de5-9f09-391172dc8114") : secret "samples-operator-tls" not found Jul 31 09:31:27.989692 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:27.989620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:27.989818 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:27.989725 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 09:31:27.989818 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:27.989736 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9c9ddb47-qfnvl: secret "image-registry-tls" not found Jul 31 09:31:27.989818 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:27.989784 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls podName:da10bd2c-f001-4d3e-8b1d-ebaa223a9485 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:29.989771594 +0000 UTC m=+41.396301702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls") pod "image-registry-5d9c9ddb47-qfnvl" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485") : secret "image-registry-tls" not found Jul 31 09:31:28.423062 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:28.423027 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nlqnw" event={"ID":"c958ada3-666d-4ff7-be9c-a827dbcdb66c","Type":"ContainerStarted","Data":"250b887583cbdac971a3099a4e1507b64b0de3e70d39c62f8ec93a080cc4a75a"} Jul 31 09:31:28.426484 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:28.426454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnxct" event={"ID":"7044dae5-8825-4d90-aab4-30b47b5600e2","Type":"ContainerStarted","Data":"3f28db0ca410be887d0631b9ce2ea56d3e0653fb0202138665ecf4b76204dd3c"} Jul 31 09:31:28.441693 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:28.441655 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nlqnw" podStartSLOduration=1.8992783389999999 podStartE2EDuration="4.441640434s" totalImagesPullingTime="2.542362095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:28.441158563 +0000 UTC m=+39.847688692" watchObservedRunningTime="2026-07-31 09:31:28.441640434 +0000 UTC m=+39.848170541" Jul 31 09:31:28.472366 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:28.472105 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mnxct" podStartSLOduration=9.46425364 podStartE2EDuration="38.472083871s" totalImagesPullingTime="29.007830231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:28.470375897 +0000 UTC m=+39.876906027" watchObservedRunningTime="2026-07-31 09:31:28.472083871 +0000 UTC m=+39.878614000" Jul 31 09:31:28.695893 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:28.695797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:28.696065 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:28.695972 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 09:31:28.696065 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:28.696046 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls podName:c8e861e1-de09-4478-b1cb-d4f2ff552c80 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:32.696025423 +0000 UTC m=+44.102555529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls") pod "dns-default-rwtww" (UID: "c8e861e1-de09-4478-b1cb-d4f2ff552c80") : secret "dns-default-metrics-tls" not found Jul 31 09:31:29.430650 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:29.430537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h" event={"ID":"65579c9a-757e-4c90-be4c-cb3abecaca61","Type":"ContainerStarted","Data":"c4baa55bc5d5b9b33618e34cd3761a790c4150973b039576137f0df021c63d80"} Jul 31 09:31:29.449068 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:29.449022 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-82f2h" podStartSLOduration=0.962825886 podStartE2EDuration="3.449008598s" totalImagesPullingTime="2.486182712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:29.447758882 +0000 UTC m=+40.854289010" watchObservedRunningTime="2026-07-31 09:31:29.449008598 +0000 UTC m=+40.855538727" Jul 31 09:31:29.907115 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:29.907077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:29.907286 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:29.907216 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 09:31:29.907329 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:29.907286 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls podName:2e46b23c-d483-4de5-9f09-391172dc8114 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:33.907270007 +0000 UTC m=+45.313800114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zrd94" (UID: "2e46b23c-d483-4de5-9f09-391172dc8114") : secret "samples-operator-tls" not found Jul 31 09:31:30.008274 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:30.008235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:30.008444 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:30.008396 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 09:31:30.008444 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:30.008418 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9c9ddb47-qfnvl: secret "image-registry-tls" not found Jul 31 09:31:30.008580 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:30.008478 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls podName:da10bd2c-f001-4d3e-8b1d-ebaa223a9485 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:34.008460679 +0000 UTC m=+45.414990787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls") pod "image-registry-5d9c9ddb47-qfnvl" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485") : secret "image-registry-tls" not found Jul 31 09:31:32.727218 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:32.727173 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:32.727594 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:32.727304 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 09:31:32.727594 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:32.727370 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls podName:c8e861e1-de09-4478-b1cb-d4f2ff552c80 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:40.727354452 +0000 UTC m=+52.133884559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls") pod "dns-default-rwtww" (UID: "c8e861e1-de09-4478-b1cb-d4f2ff552c80") : secret "dns-default-metrics-tls" not found Jul 31 09:31:32.930831 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:32.930800 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ztxsb"] Jul 31 09:31:32.963784 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:32.963757 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ztxsb"] Jul 31 09:31:32.963932 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:32.963888 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:32.966556 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:32.966520 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 31 09:31:32.966657 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:32.966597 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k5snr\"" Jul 31 09:31:32.966935 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:32.966923 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 31 09:31:32.967696 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:32.967680 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 31 09:31:32.967696 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:32.967687 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 31 09:31:33.030874 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.030698 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.030874 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.030735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54698be4-bc69-4fda-a403-1d04e0dd0a7c-crio-socket\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.030874 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.030756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54698be4-bc69-4fda-a403-1d04e0dd0a7c-data-volume\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.030874 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.030776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.030874 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.030793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcktc\" (UniqueName: \"kubernetes.io/projected/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-api-access-mcktc\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.131463 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.131427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.131463 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.131460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54698be4-bc69-4fda-a403-1d04e0dd0a7c-crio-socket\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.131641 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.131480 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54698be4-bc69-4fda-a403-1d04e0dd0a7c-data-volume\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.131641 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.131496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.131641 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.131600 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 09:31:33.131641 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.131618 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 09:31:33.131780 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.131649 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls podName:54698be4-bc69-4fda-a403-1d04e0dd0a7c nodeName:}" failed. No retries permitted until 2026-07-31 09:31:33.631635749 +0000 UTC m=+45.038165855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztxsb" (UID: "54698be4-bc69-4fda-a403-1d04e0dd0a7c") : secret "insights-runtime-extractor-tls" not found Jul 31 09:31:33.131780 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.131688 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm podName:54698be4-bc69-4fda-a403-1d04e0dd0a7c nodeName:}" failed. No retries permitted until 2026-07-31 09:31:33.631670319 +0000 UTC m=+45.038200458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ztxsb" (UID: "54698be4-bc69-4fda-a403-1d04e0dd0a7c") : configmap "kube-rbac-proxy" not found Jul 31 09:31:33.131780 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.131707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcktc\" (UniqueName: \"kubernetes.io/projected/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-api-access-mcktc\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.131780 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.131682 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54698be4-bc69-4fda-a403-1d04e0dd0a7c-crio-socket\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.131916 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.131843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54698be4-bc69-4fda-a403-1d04e0dd0a7c-data-volume\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.145894 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.145872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcktc\" (UniqueName: \"kubernetes.io/projected/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-api-access-mcktc\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.635000 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.634964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.635000 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.635003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:33.635217 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.635079 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 09:31:33.635217 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.635091 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 09:31:33.635217 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.635139 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls podName:54698be4-bc69-4fda-a403-1d04e0dd0a7c nodeName:}" failed. No retries permitted until 2026-07-31 09:31:34.635125966 +0000 UTC m=+46.041656073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztxsb" (UID: "54698be4-bc69-4fda-a403-1d04e0dd0a7c") : secret "insights-runtime-extractor-tls" not found Jul 31 09:31:33.635217 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.635152 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm podName:54698be4-bc69-4fda-a403-1d04e0dd0a7c nodeName:}" failed. No retries permitted until 2026-07-31 09:31:34.63514533 +0000 UTC m=+46.041675436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ztxsb" (UID: "54698be4-bc69-4fda-a403-1d04e0dd0a7c") : configmap "kube-rbac-proxy" not found Jul 31 09:31:33.816360 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.816327 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-jh6dz"] Jul 31 09:31:33.827877 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.827855 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-jh6dz"] Jul 31 09:31:33.828005 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.827944 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:33.830950 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.830923 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 31 09:31:33.831073 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.830987 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 31 09:31:33.832043 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.832021 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rtcdr\"" Jul 31 09:31:33.832201 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.832080 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 31 09:31:33.832201 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.832029 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 31 09:31:33.837004 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.836985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b4bb9ada-3ca0-4a48-8844-d22709a25429-signing-cabundle\") pod \"service-ca-98c88fbb5-jh6dz\" (UID: \"b4bb9ada-3ca0-4a48-8844-d22709a25429\") " pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:33.837101 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.837009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvpsq\" (UniqueName: \"kubernetes.io/projected/b4bb9ada-3ca0-4a48-8844-d22709a25429-kube-api-access-qvpsq\") pod \"service-ca-98c88fbb5-jh6dz\" (UID: \"b4bb9ada-3ca0-4a48-8844-d22709a25429\") " pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:33.837101 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.837038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b4bb9ada-3ca0-4a48-8844-d22709a25429-signing-key\") pod \"service-ca-98c88fbb5-jh6dz\" (UID: \"b4bb9ada-3ca0-4a48-8844-d22709a25429\") " pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:33.937963 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.937892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:33.937963 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.937933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b4bb9ada-3ca0-4a48-8844-d22709a25429-signing-cabundle\") pod \"service-ca-98c88fbb5-jh6dz\" (UID: \"b4bb9ada-3ca0-4a48-8844-d22709a25429\") " pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:33.937963 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.937957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvpsq\" (UniqueName: \"kubernetes.io/projected/b4bb9ada-3ca0-4a48-8844-d22709a25429-kube-api-access-qvpsq\") pod \"service-ca-98c88fbb5-jh6dz\" (UID: \"b4bb9ada-3ca0-4a48-8844-d22709a25429\") " pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:33.938173 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.937991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b4bb9ada-3ca0-4a48-8844-d22709a25429-signing-key\") pod \"service-ca-98c88fbb5-jh6dz\" (UID: \"b4bb9ada-3ca0-4a48-8844-d22709a25429\") " pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:33.938173 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.938054 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 09:31:33.938173 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:33.938115 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls podName:2e46b23c-d483-4de5-9f09-391172dc8114 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:41.93809831 +0000 UTC m=+53.344628430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zrd94" (UID: "2e46b23c-d483-4de5-9f09-391172dc8114") : secret "samples-operator-tls" not found Jul 31 09:31:33.938645 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.938619 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b4bb9ada-3ca0-4a48-8844-d22709a25429-signing-cabundle\") pod \"service-ca-98c88fbb5-jh6dz\" (UID: \"b4bb9ada-3ca0-4a48-8844-d22709a25429\") " pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:33.940319 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.940299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b4bb9ada-3ca0-4a48-8844-d22709a25429-signing-key\") pod \"service-ca-98c88fbb5-jh6dz\" (UID: \"b4bb9ada-3ca0-4a48-8844-d22709a25429\") " pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:33.946865 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:33.946843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvpsq\" (UniqueName: \"kubernetes.io/projected/b4bb9ada-3ca0-4a48-8844-d22709a25429-kube-api-access-qvpsq\") pod \"service-ca-98c88fbb5-jh6dz\" (UID: \"b4bb9ada-3ca0-4a48-8844-d22709a25429\") " pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:34.039161 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:34.039125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:34.039362 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:34.039274 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 09:31:34.039362 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:34.039295 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9c9ddb47-qfnvl: secret "image-registry-tls" not found Jul 31 09:31:34.039362 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:34.039357 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls podName:da10bd2c-f001-4d3e-8b1d-ebaa223a9485 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:42.039342356 +0000 UTC m=+53.445872463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls") pod "image-registry-5d9c9ddb47-qfnvl" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485") : secret "image-registry-tls" not found Jul 31 09:31:34.137241 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:34.137208 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" Jul 31 09:31:34.278371 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:34.278287 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-jh6dz"] Jul 31 09:31:34.280854 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:34.280828 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bb9ada_3ca0_4a48_8844_d22709a25429.slice/crio-d2e879b4bc7d5c2dbf0c9a9bf9491fadcf550475e3e80256f550456ba6730e61 WatchSource:0}: Error finding container d2e879b4bc7d5c2dbf0c9a9bf9491fadcf550475e3e80256f550456ba6730e61: Status 404 returned error can't find the container with id d2e879b4bc7d5c2dbf0c9a9bf9491fadcf550475e3e80256f550456ba6730e61 Jul 31 09:31:34.443554 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:34.443521 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" event={"ID":"b4bb9ada-3ca0-4a48-8844-d22709a25429","Type":"ContainerStarted","Data":"d2e879b4bc7d5c2dbf0c9a9bf9491fadcf550475e3e80256f550456ba6730e61"} Jul 31 09:31:34.644729 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:34.644694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:34.644907 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:34.644742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:34.644907 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:34.644818 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 09:31:34.644907 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:34.644884 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm podName:54698be4-bc69-4fda-a403-1d04e0dd0a7c nodeName:}" failed. No retries permitted until 2026-07-31 09:31:36.644867348 +0000 UTC m=+48.051397454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ztxsb" (UID: "54698be4-bc69-4fda-a403-1d04e0dd0a7c") : configmap "kube-rbac-proxy" not found Jul 31 09:31:34.645039 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:34.644919 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 09:31:34.645039 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:34.644972 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls podName:54698be4-bc69-4fda-a403-1d04e0dd0a7c nodeName:}" failed. No retries permitted until 2026-07-31 09:31:36.64495989 +0000 UTC m=+48.051489996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztxsb" (UID: "54698be4-bc69-4fda-a403-1d04e0dd0a7c") : secret "insights-runtime-extractor-tls" not found Jul 31 09:31:35.675999 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:35.675972 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q2pvs_3c86319d-26ad-4dc0-938c-2fc9e87a8945/dns-node-resolver/0.log" Jul 31 09:31:36.659046 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:36.659013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:36.659200 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:36.659172 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 09:31:36.659240 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:36.659200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:36.659240 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:36.659232 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls podName:54698be4-bc69-4fda-a403-1d04e0dd0a7c nodeName:}" failed. No retries permitted until 2026-07-31 09:31:40.659217463 +0000 UTC m=+52.065747570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztxsb" (UID: "54698be4-bc69-4fda-a403-1d04e0dd0a7c") : secret "insights-runtime-extractor-tls" not found Jul 31 09:31:36.659681 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:36.659662 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54698be4-bc69-4fda-a403-1d04e0dd0a7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:36.676340 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:36.676292 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2fjx_545bfd62-358c-4743-80df-242a578ecf2f/node-ca/0.log" Jul 31 09:31:37.452424 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:37.452387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" event={"ID":"b4bb9ada-3ca0-4a48-8844-d22709a25429","Type":"ContainerStarted","Data":"62cd0027732e41d56bf1cc4e9bc63a2a9b8403b019c1736261de42917f67fec6"} Jul 31 09:31:37.472571 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:37.470710 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-jh6dz" podStartSLOduration=2.051055312 podStartE2EDuration="4.470692001s" totalImagesPullingTime="2.419636689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:37.468905614 +0000 UTC m=+48.875435747" watchObservedRunningTime="2026-07-31 09:31:37.470692001 +0000 UTC m=+48.877222131" Jul 31 09:31:37.476585 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:37.476562 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nlqnw_c958ada3-666d-4ff7-be9c-a827dbcdb66c/serve-healthcheck-canary/0.log" Jul 31 09:31:40.688180 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:40.688132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:40.688673 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:40.688297 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 09:31:40.688673 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:40.688376 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls podName:54698be4-bc69-4fda-a403-1d04e0dd0a7c nodeName:}" failed. No retries permitted until 2026-07-31 09:31:48.688354977 +0000 UTC m=+60.094885092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztxsb" (UID: "54698be4-bc69-4fda-a403-1d04e0dd0a7c") : secret "insights-runtime-extractor-tls" not found Jul 31 09:31:40.788512 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:40.788470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:40.788692 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:40.788627 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 09:31:40.788742 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:31:40.788694 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls podName:c8e861e1-de09-4478-b1cb-d4f2ff552c80 nodeName:}" failed. No retries permitted until 2026-07-31 09:31:56.788674168 +0000 UTC m=+68.195204275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls") pod "dns-default-rwtww" (UID: "c8e861e1-de09-4478-b1cb-d4f2ff552c80") : secret "dns-default-metrics-tls" not found Jul 31 09:31:41.999000 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:41.998960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:42.001277 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:42.001258 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e46b23c-d483-4de5-9f09-391172dc8114-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zrd94\" (UID: \"2e46b23c-d483-4de5-9f09-391172dc8114\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:42.081917 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:42.081886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" Jul 31 09:31:42.099670 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:42.099641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:42.101900 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:42.101874 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") pod \"image-registry-5d9c9ddb47-qfnvl\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:42.194095 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:42.194065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:42.214798 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:42.214769 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94"] Jul 31 09:31:42.353908 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:42.353881 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d9c9ddb47-qfnvl"] Jul 31 09:31:42.356559 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:42.356524 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda10bd2c_f001_4d3e_8b1d_ebaa223a9485.slice/crio-81b9d84218da9e3b37f06abb15293345eb5bc2a963e4641b49ff14e12f017113 WatchSource:0}: Error finding container 81b9d84218da9e3b37f06abb15293345eb5bc2a963e4641b49ff14e12f017113: Status 404 returned error can't find the container with id 81b9d84218da9e3b37f06abb15293345eb5bc2a963e4641b49ff14e12f017113 Jul 31 09:31:42.467146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:42.467116 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" event={"ID":"da10bd2c-f001-4d3e-8b1d-ebaa223a9485","Type":"ContainerStarted","Data":"81b9d84218da9e3b37f06abb15293345eb5bc2a963e4641b49ff14e12f017113"} Jul 31 09:31:42.468189 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:42.468165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" event={"ID":"2e46b23c-d483-4de5-9f09-391172dc8114","Type":"ContainerStarted","Data":"a2005465ad3f48f2b52b4fe49e58ee1da667d915a1436568d69c8f648a34d794"} Jul 31 09:31:43.472226 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:43.472190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" event={"ID":"da10bd2c-f001-4d3e-8b1d-ebaa223a9485","Type":"ContainerStarted","Data":"edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662"} Jul 31 09:31:43.472599 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:43.472324 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:31:43.496745 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:43.496691 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" podStartSLOduration=17.496671223 podStartE2EDuration="17.496671223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:31:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:43.494872919 +0000 UTC m=+54.901403049" watchObservedRunningTime="2026-07-31 09:31:43.496671223 +0000 UTC m=+54.903201363" Jul 31 09:31:44.478758 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:44.478671 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" event={"ID":"2e46b23c-d483-4de5-9f09-391172dc8114","Type":"ContainerStarted","Data":"0567a8c8846edf21d40564d66d04da228004244d704a2ee63302a8ac7968a2cf"} Jul 31 09:31:44.478758 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:44.478734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" event={"ID":"2e46b23c-d483-4de5-9f09-391172dc8114","Type":"ContainerStarted","Data":"97c6bb930751a188504f2c5febdaa539f6debb56bb0a31f88afcc7aa85c4053e"} Jul 31 09:31:44.496690 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:44.496647 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zrd94" podStartSLOduration=16.663922013 podStartE2EDuration="18.496633469s" totalImagesPullingTime="1.832711456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:44.495334677 +0000 UTC m=+55.901864805" watchObservedRunningTime="2026-07-31 09:31:44.496633469 +0000 UTC m=+55.903163597" Jul 31 09:31:48.392822 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:48.392795 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76zkr" Jul 31 09:31:48.754882 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:48.754795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:48.757016 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:48.756988 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54698be4-bc69-4fda-a403-1d04e0dd0a7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztxsb\" (UID: \"54698be4-bc69-4fda-a403-1d04e0dd0a7c\") " pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:48.873324 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:48.873280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ztxsb" Jul 31 09:31:48.999488 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:48.999394 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ztxsb"] Jul 31 09:31:49.002426 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:49.002389 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54698be4_bc69_4fda_a403_1d04e0dd0a7c.slice/crio-718cf76366716b0be0a266f43547074eb22abfdd4f621514e3fa8fcb0d62398c WatchSource:0}: Error finding container 718cf76366716b0be0a266f43547074eb22abfdd4f621514e3fa8fcb0d62398c: Status 404 returned error can't find the container with id 718cf76366716b0be0a266f43547074eb22abfdd4f621514e3fa8fcb0d62398c Jul 31 09:31:49.496413 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:49.496380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztxsb" event={"ID":"54698be4-bc69-4fda-a403-1d04e0dd0a7c","Type":"ContainerStarted","Data":"ccbe6fd0bc17d17152dfede2dd8505bf1a84e3470215c2dc0c2d8028fe41359d"} Jul 31 09:31:49.496818 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:49.496445 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztxsb" event={"ID":"54698be4-bc69-4fda-a403-1d04e0dd0a7c","Type":"ContainerStarted","Data":"718cf76366716b0be0a266f43547074eb22abfdd4f621514e3fa8fcb0d62398c"} Jul 31 09:31:50.500789 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:50.500713 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztxsb" event={"ID":"54698be4-bc69-4fda-a403-1d04e0dd0a7c","Type":"ContainerStarted","Data":"020fbcbbf4f03763f1365c176f5f5c7baa95f8591517ae46013bb6a097fa7cad"} Jul 31 09:31:52.511685 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.511645 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztxsb" event={"ID":"54698be4-bc69-4fda-a403-1d04e0dd0a7c","Type":"ContainerStarted","Data":"8de04d68aac7264e54018cca85604e50f29c11643c6b31cafc5c280905c85fe7"} Jul 31 09:31:52.533056 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.533009 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ztxsb" podStartSLOduration=18.189152366 podStartE2EDuration="20.532994631s" totalImagesPullingTime="2.343842265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:31:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:52.532349163 +0000 UTC m=+63.938879293" watchObservedRunningTime="2026-07-31 09:31:52.532994631 +0000 UTC m=+63.939524760" Jul 31 09:31:52.582258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.582226 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm"] Jul 31 09:31:52.585139 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.585115 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" Jul 31 09:31:52.588602 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.588579 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 31 09:31:52.589091 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.589077 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 31 09:31:52.589186 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.589088 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 31 09:31:52.589506 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.589490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 31 09:31:52.591356 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.589658 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6gm2z\"" Jul 31 09:31:52.602405 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.602383 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm"] Jul 31 09:31:52.634106 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.634080 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d9c9ddb47-qfnvl"] Jul 31 09:31:52.684894 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.684863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xm4w\" (UniqueName: \"kubernetes.io/projected/6a4813e3-53f9-4a11-bde7-694028a11b89-kube-api-access-8xm4w\") pod \"managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm\" (UID: \"6a4813e3-53f9-4a11-bde7-694028a11b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" Jul 31 09:31:52.684894 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.684896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a4813e3-53f9-4a11-bde7-694028a11b89-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm\" (UID: \"6a4813e3-53f9-4a11-bde7-694028a11b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" Jul 31 09:31:52.785896 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.785811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xm4w\" (UniqueName: \"kubernetes.io/projected/6a4813e3-53f9-4a11-bde7-694028a11b89-kube-api-access-8xm4w\") pod \"managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm\" (UID: \"6a4813e3-53f9-4a11-bde7-694028a11b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" Jul 31 09:31:52.785896 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.785847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a4813e3-53f9-4a11-bde7-694028a11b89-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm\" (UID: \"6a4813e3-53f9-4a11-bde7-694028a11b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" Jul 31 09:31:52.788288 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.788264 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a4813e3-53f9-4a11-bde7-694028a11b89-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm\" (UID: \"6a4813e3-53f9-4a11-bde7-694028a11b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" Jul 31 09:31:52.804747 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.804717 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xm4w\" (UniqueName: \"kubernetes.io/projected/6a4813e3-53f9-4a11-bde7-694028a11b89-kube-api-access-8xm4w\") pod \"managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm\" (UID: \"6a4813e3-53f9-4a11-bde7-694028a11b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" Jul 31 09:31:52.905791 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:52.905753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" Jul 31 09:31:53.047169 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.047093 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm"] Jul 31 09:31:53.049981 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:53.049952 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a4813e3_53f9_4a11_bde7_694028a11b89.slice/crio-2e1a052e0f1da3c4148c4c2741adfebba157303cf588588688a8b21d347200c6 WatchSource:0}: Error finding container 2e1a052e0f1da3c4148c4c2741adfebba157303cf588588688a8b21d347200c6: Status 404 returned error can't find the container with id 2e1a052e0f1da3c4148c4c2741adfebba157303cf588588688a8b21d347200c6 Jul 31 09:31:53.515918 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.515876 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" event={"ID":"6a4813e3-53f9-4a11-bde7-694028a11b89","Type":"ContainerStarted","Data":"2e1a052e0f1da3c4148c4c2741adfebba157303cf588588688a8b21d347200c6"} Jul 31 09:31:53.530406 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.530378 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-6xj9l"] Jul 31 09:31:53.534445 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.534429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-6xj9l" Jul 31 09:31:53.540505 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.540419 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 31 09:31:53.540505 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.540419 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8mjpc\"" Jul 31 09:31:53.540505 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.540454 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 31 09:31:53.546783 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.546762 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-6xj9l"] Jul 31 09:31:53.591911 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.591868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdcgx\" (UniqueName: \"kubernetes.io/projected/1b2ee657-db62-49ae-a679-c8973ac76cec-kube-api-access-qdcgx\") pod \"downloads-77c974ffcf-6xj9l\" (UID: \"1b2ee657-db62-49ae-a679-c8973ac76cec\") " pod="openshift-console/downloads-77c974ffcf-6xj9l" Jul 31 09:31:53.692940 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.692904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcgx\" (UniqueName: \"kubernetes.io/projected/1b2ee657-db62-49ae-a679-c8973ac76cec-kube-api-access-qdcgx\") pod \"downloads-77c974ffcf-6xj9l\" (UID: \"1b2ee657-db62-49ae-a679-c8973ac76cec\") " pod="openshift-console/downloads-77c974ffcf-6xj9l" Jul 31 09:31:53.704378 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.704346 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdcgx\" (UniqueName: \"kubernetes.io/projected/1b2ee657-db62-49ae-a679-c8973ac76cec-kube-api-access-qdcgx\") pod \"downloads-77c974ffcf-6xj9l\" (UID: \"1b2ee657-db62-49ae-a679-c8973ac76cec\") " pod="openshift-console/downloads-77c974ffcf-6xj9l" Jul 31 09:31:53.843814 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.843630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-6xj9l" Jul 31 09:31:53.999133 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:53.999102 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-6xj9l"] Jul 31 09:31:54.003499 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:54.003467 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2ee657_db62_49ae_a679_c8973ac76cec.slice/crio-66e02f4322c6084e62e72aac3b103beb7b6c1b0497bf47d5a501bf32d9d3d653 WatchSource:0}: Error finding container 66e02f4322c6084e62e72aac3b103beb7b6c1b0497bf47d5a501bf32d9d3d653: Status 404 returned error can't find the container with id 66e02f4322c6084e62e72aac3b103beb7b6c1b0497bf47d5a501bf32d9d3d653 Jul 31 09:31:54.520299 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.520254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-6xj9l" event={"ID":"1b2ee657-db62-49ae-a679-c8973ac76cec","Type":"ContainerStarted","Data":"66e02f4322c6084e62e72aac3b103beb7b6c1b0497bf47d5a501bf32d9d3d653"} Jul 31 09:31:54.802881 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.802799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:54.802881 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.802854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:54.806704 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.806679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 09:31:54.807628 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.807612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 09:31:54.816387 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.816367 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83740ca-ebfe-45da-bee7-220b954c33d3-metrics-certs\") pod \"network-metrics-daemon-9cbhc\" (UID: \"d83740ca-ebfe-45da-bee7-220b954c33d3\") " pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:54.816490 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.816422 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11f6c97c-7d6f-4745-9d75-4a3577df3081-original-pull-secret\") pod \"global-pull-secret-syncer-9f5rs\" (UID: \"11f6c97c-7d6f-4745-9d75-4a3577df3081\") " pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:54.901608 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.901576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f5rs" Jul 31 09:31:54.903880 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.903856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:54.908788 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.908769 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 09:31:54.918246 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.918228 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 09:31:54.918703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.918689 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-25l5h\"" Jul 31 09:31:54.926322 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.926298 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9cbhc" Jul 31 09:31:54.927319 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:54.927297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xbx2\" (UniqueName: \"kubernetes.io/projected/15756e9c-2f7b-453a-995f-e13c9bd0be46-kube-api-access-9xbx2\") pod \"network-check-target-z65mq\" (UID: \"15756e9c-2f7b-453a-995f-e13c9bd0be46\") " pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:55.215558 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:55.215520 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nfbq9\"" Jul 31 09:31:55.222426 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:55.222365 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:31:55.390698 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:55.390664 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9f5rs"] Jul 31 09:31:55.394494 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:55.394472 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f6c97c_7d6f_4745_9d75_4a3577df3081.slice/crio-59ce985b6c90e1ff894f78173d5baa0143a4b2896dcae498da2389e497f57a12 WatchSource:0}: Error finding container 59ce985b6c90e1ff894f78173d5baa0143a4b2896dcae498da2389e497f57a12: Status 404 returned error can't find the container with id 59ce985b6c90e1ff894f78173d5baa0143a4b2896dcae498da2389e497f57a12 Jul 31 09:31:55.524999 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:55.524911 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" event={"ID":"6a4813e3-53f9-4a11-bde7-694028a11b89","Type":"ContainerStarted","Data":"c676728df6788faee80ced4f075112a024e5ff4796030b905db1f765b6953713"} Jul 31 09:31:55.526317 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:55.526286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9f5rs" event={"ID":"11f6c97c-7d6f-4745-9d75-4a3577df3081","Type":"ContainerStarted","Data":"59ce985b6c90e1ff894f78173d5baa0143a4b2896dcae498da2389e497f57a12"} Jul 31 09:31:55.542924 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:55.542873 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5496c6fb-d2gxm" podStartSLOduration=1.286368148 podStartE2EDuration="3.542855002s" totalImagesPullingTime="2.256486854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:55.542244587 +0000 UTC m=+66.948774715" watchObservedRunningTime="2026-07-31 09:31:55.542855002 +0000 UTC m=+66.949385136" Jul 31 09:31:55.609864 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:55.609830 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9cbhc"] Jul 31 09:31:55.614070 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:55.613981 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z65mq"] Jul 31 09:31:55.614204 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:55.614177 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83740ca_ebfe_45da_bee7_220b954c33d3.slice/crio-0116046c7e0e04b31cb1ee9873146dbeab0f7ef0c20645fbcc6a4597fc10b6f9 WatchSource:0}: Error finding container 0116046c7e0e04b31cb1ee9873146dbeab0f7ef0c20645fbcc6a4597fc10b6f9: Status 404 returned error can't find the container with id 0116046c7e0e04b31cb1ee9873146dbeab0f7ef0c20645fbcc6a4597fc10b6f9 Jul 31 09:31:55.615935 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:55.615906 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15756e9c_2f7b_453a_995f_e13c9bd0be46.slice/crio-a0cf090461388d5337f41e54999a73cd80da7fa320f052ebd09042e2aa71b588 WatchSource:0}: Error finding container a0cf090461388d5337f41e54999a73cd80da7fa320f052ebd09042e2aa71b588: Status 404 returned error can't find the container with id a0cf090461388d5337f41e54999a73cd80da7fa320f052ebd09042e2aa71b588 Jul 31 09:31:56.534169 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:56.534039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z65mq" event={"ID":"15756e9c-2f7b-453a-995f-e13c9bd0be46","Type":"ContainerStarted","Data":"a0cf090461388d5337f41e54999a73cd80da7fa320f052ebd09042e2aa71b588"} Jul 31 09:31:56.536496 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:56.536376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9cbhc" event={"ID":"d83740ca-ebfe-45da-bee7-220b954c33d3","Type":"ContainerStarted","Data":"0116046c7e0e04b31cb1ee9873146dbeab0f7ef0c20645fbcc6a4597fc10b6f9"} Jul 31 09:31:56.820709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:56.820612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:56.823562 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:56.823519 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8e861e1-de09-4478-b1cb-d4f2ff552c80-metrics-tls\") pod \"dns-default-rwtww\" (UID: \"c8e861e1-de09-4478-b1cb-d4f2ff552c80\") " pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:57.068905 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:57.068874 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2x7rl\"" Jul 31 09:31:57.076327 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:57.076257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwtww" Jul 31 09:31:57.323232 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:57.323159 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwtww"] Jul 31 09:31:57.333917 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:31:57.333878 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e861e1_de09_4478_b1cb_d4f2ff552c80.slice/crio-e71054dc2552f7e0e799e3de444a5c9cb4af68c2725f18398ea6d946dfea145b WatchSource:0}: Error finding container e71054dc2552f7e0e799e3de444a5c9cb4af68c2725f18398ea6d946dfea145b: Status 404 returned error can't find the container with id e71054dc2552f7e0e799e3de444a5c9cb4af68c2725f18398ea6d946dfea145b Jul 31 09:31:57.542298 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:57.542259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9cbhc" event={"ID":"d83740ca-ebfe-45da-bee7-220b954c33d3","Type":"ContainerStarted","Data":"d52571224b995bf295d7f427cd06a0c264fe277bec9a3f2f2aee4cdad3cef710"} Jul 31 09:31:57.544604 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:57.544559 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwtww" event={"ID":"c8e861e1-de09-4478-b1cb-d4f2ff552c80","Type":"ContainerStarted","Data":"e71054dc2552f7e0e799e3de444a5c9cb4af68c2725f18398ea6d946dfea145b"} Jul 31 09:31:58.552177 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:31:58.552110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9cbhc" event={"ID":"d83740ca-ebfe-45da-bee7-220b954c33d3","Type":"ContainerStarted","Data":"683ac6d617f276079b1dc9ef8f680e93fc9c00c7bfb882e4879eb265a5fe3ace"} Jul 31 09:32:01.644243 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.644181 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9cbhc" podStartSLOduration=70.102817001 podStartE2EDuration="1m11.644155917s" totalImagesPullingTime="1.541338916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:31:58.573360596 +0000 UTC m=+69.979890726" watchObservedRunningTime="2026-07-31 09:32:01.644155917 +0000 UTC m=+73.050686049" Jul 31 09:32:01.644940 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.644824 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bdf7d4cd8-m428c"] Jul 31 09:32:01.648336 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.648306 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.651360 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.651322 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 31 09:32:01.651360 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.651325 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 31 09:32:01.651751 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.651631 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 31 09:32:01.652537 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.652515 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 31 09:32:01.652643 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.652595 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 31 09:32:01.652712 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.652674 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ctfwv\"" Jul 31 09:32:01.660158 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.660135 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdf7d4cd8-m428c"] Jul 31 09:32:01.764371 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.764089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-oauth-serving-cert\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.764371 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.764190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccvct\" (UniqueName: \"kubernetes.io/projected/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-kube-api-access-ccvct\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.764371 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.764274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-serving-cert\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.764371 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.764298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-oauth-config\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.764371 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.764336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-config\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.764704 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.764387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-service-ca\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.868244 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.865489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-oauth-serving-cert\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.868244 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.865536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccvct\" (UniqueName: \"kubernetes.io/projected/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-kube-api-access-ccvct\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.868244 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.865598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-serving-cert\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.868244 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.865621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-oauth-config\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.868244 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.865655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-config\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.868244 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.865700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-service-ca\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.868244 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.866371 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-service-ca\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.868244 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.866891 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-oauth-serving-cert\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.868747 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.868330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-config\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.870992 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.870964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-oauth-config\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.874215 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.874186 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-serving-cert\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.877959 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.877934 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccvct\" (UniqueName: \"kubernetes.io/projected/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-kube-api-access-ccvct\") pod \"console-7bdf7d4cd8-m428c\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:01.961027 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:01.960831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:02.133166 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.133087 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdf7d4cd8-m428c"] Jul 31 09:32:02.136200 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:32:02.136168 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc3787d_4cec_4e7e_ae23_a60497fe1f3e.slice/crio-270f54c9e0eeba71952f6da1c6f24e50142376ec4732aa91ed8e1765e41c3622 WatchSource:0}: Error finding container 270f54c9e0eeba71952f6da1c6f24e50142376ec4732aa91ed8e1765e41c3622: Status 404 returned error can't find the container with id 270f54c9e0eeba71952f6da1c6f24e50142376ec4732aa91ed8e1765e41c3622 Jul 31 09:32:02.571241 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.571115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwtww" event={"ID":"c8e861e1-de09-4478-b1cb-d4f2ff552c80","Type":"ContainerStarted","Data":"b37d65558bd5db9e6748471b697297b078e60d572124d43c822a476df7d2bb3e"} Jul 31 09:32:02.571241 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.571178 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rwtww" Jul 31 09:32:02.571241 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.571207 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwtww" event={"ID":"c8e861e1-de09-4478-b1cb-d4f2ff552c80","Type":"ContainerStarted","Data":"34663e37783bfd4bef862d248e457297a6ecf494048a9c0d18c1617aaf3d655f"} Jul 31 09:32:02.572790 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.572762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z65mq" event={"ID":"15756e9c-2f7b-453a-995f-e13c9bd0be46","Type":"ContainerStarted","Data":"15d1f2c5007407e63a2da3cf2ab8850dfe6af1fa5f4de1caf1f6b3b422775b37"} Jul 31 09:32:02.572916 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.572884 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:32:02.574353 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.574322 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9f5rs" event={"ID":"11f6c97c-7d6f-4745-9d75-4a3577df3081","Type":"ContainerStarted","Data":"514e275190dec436470e17e8efea29d48ac737e79a3cab7e1f8a45371353dad3"} Jul 31 09:32:02.575660 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.575640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdf7d4cd8-m428c" event={"ID":"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e","Type":"ContainerStarted","Data":"270f54c9e0eeba71952f6da1c6f24e50142376ec4732aa91ed8e1765e41c3622"} Jul 31 09:32:02.594773 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.594736 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rwtww" podStartSLOduration=34.121983184 podStartE2EDuration="38.594722972s" totalImagesPullingTime="4.472739788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:02.59269713 +0000 UTC m=+73.999227283" watchObservedRunningTime="2026-07-31 09:32:02.594722972 +0000 UTC m=+74.001253101" Jul 31 09:32:02.615880 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.615818 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9f5rs" podStartSLOduration=66.209282644 podStartE2EDuration="1m12.615806149s" totalImagesPullingTime="6.406523505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:02.61496289 +0000 UTC m=+74.021493019" watchObservedRunningTime="2026-07-31 09:32:02.615806149 +0000 UTC m=+74.022336256" Jul 31 09:32:02.641284 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.641257 2578 patch_prober.go:28] interesting pod/image-registry-5d9c9ddb47-qfnvl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 09:32:02.641394 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.641310 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" podUID="da10bd2c-f001-4d3e-8b1d-ebaa223a9485" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 09:32:02.645429 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:02.645389 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z65mq" podStartSLOduration=66.447070209 podStartE2EDuration="1m12.645374218s" totalImagesPullingTime="6.198304009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:02.644793773 +0000 UTC m=+74.051323900" watchObservedRunningTime="2026-07-31 09:32:02.645374218 +0000 UTC m=+74.051904347" Jul 31 09:32:04.037308 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:04.037275 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22"] Jul 31 09:32:04.040386 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:04.040362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" Jul 31 09:32:04.043490 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:04.043466 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 31 09:32:04.044313 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:04.044137 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kmn42\"" Jul 31 09:32:04.068752 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:04.068729 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22"] Jul 31 09:32:04.184353 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:04.184305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03c51db6-d1a6-44a0-a0d1-dbb6a9c98d73-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-srd22\" (UID: \"03c51db6-d1a6-44a0-a0d1-dbb6a9c98d73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" Jul 31 09:32:04.285872 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:04.285392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03c51db6-d1a6-44a0-a0d1-dbb6a9c98d73-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-srd22\" (UID: \"03c51db6-d1a6-44a0-a0d1-dbb6a9c98d73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" Jul 31 09:32:04.288523 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:04.288463 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03c51db6-d1a6-44a0-a0d1-dbb6a9c98d73-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-srd22\" (UID: \"03c51db6-d1a6-44a0-a0d1-dbb6a9c98d73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" Jul 31 09:32:04.352807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:04.352557 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" Jul 31 09:32:05.403617 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:05.403590 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22"] Jul 31 09:32:05.593929 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:05.593879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdf7d4cd8-m428c" event={"ID":"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e","Type":"ContainerStarted","Data":"36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca"} Jul 31 09:32:05.595383 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:05.595348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" event={"ID":"03c51db6-d1a6-44a0-a0d1-dbb6a9c98d73","Type":"ContainerStarted","Data":"aac2b58a2e326b2289448088da233c96e405dbc53679178025757f0e1faffa0e"} Jul 31 09:32:05.613847 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:05.613803 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bdf7d4cd8-m428c" podStartSLOduration=1.438049464 podStartE2EDuration="4.61378805s" totalImagesPullingTime="3.175738586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:05.612768692 +0000 UTC m=+77.019298821" watchObservedRunningTime="2026-07-31 09:32:05.61378805 +0000 UTC m=+77.020318179" Jul 31 09:32:11.961665 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:11.961509 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:11.961665 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:11.961601 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:11.966982 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:11.966956 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:12.590848 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:12.590814 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rwtww" Jul 31 09:32:12.631820 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:12.631801 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:12.640165 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:12.640057 2578 patch_prober.go:28] interesting pod/image-registry-5d9c9ddb47-qfnvl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 09:32:12.640165 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:12.640100 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" podUID="da10bd2c-f001-4d3e-8b1d-ebaa223a9485" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 09:32:13.627315 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:13.627269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-6xj9l" event={"ID":"1b2ee657-db62-49ae-a679-c8973ac76cec","Type":"ContainerStarted","Data":"723b30635b4bbdbbf4b546f68d11b50889daf1b45931b42958516583c31c200c"} Jul 31 09:32:13.627811 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:13.627535 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-6xj9l" Jul 31 09:32:13.646164 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:13.646138 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-6xj9l" Jul 31 09:32:13.649894 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:13.649849 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-6xj9l" podStartSLOduration=2.039931781 podStartE2EDuration="20.649835589s" totalImagesPullingTime="18.609903808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:31:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:13.647688855 +0000 UTC m=+85.054218985" watchObservedRunningTime="2026-07-31 09:32:13.649835589 +0000 UTC m=+85.056365718" Jul 31 09:32:14.633089 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:14.633045 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" event={"ID":"03c51db6-d1a6-44a0-a0d1-dbb6a9c98d73","Type":"ContainerStarted","Data":"91593714b682c945f0242f41199d970ce53b29844762d4a0dfa665f05dc9453a"} Jul 31 09:32:14.633581 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:14.633280 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" Jul 31 09:32:14.639077 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:14.639055 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" Jul 31 09:32:14.654690 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:14.654645 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-srd22" podStartSLOduration=2.359227735 podStartE2EDuration="10.654630886s" totalImagesPullingTime="8.295403151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:14.654014402 +0000 UTC m=+86.060544532" watchObservedRunningTime="2026-07-31 09:32:14.654630886 +0000 UTC m=+86.061161016" Jul 31 09:32:15.090195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.090162 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-6qp98"] Jul 31 09:32:15.134519 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.134478 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-6qp98"] Jul 31 09:32:15.134694 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.134621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.137651 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.137625 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 31 09:32:15.137896 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.137719 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 31 09:32:15.138015 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.137993 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 31 09:32:15.138759 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.138738 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 31 09:32:15.138896 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.138879 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 31 09:32:15.139137 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.139116 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-snngf\"" Jul 31 09:32:15.271041 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.271002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a84378e0-7397-47b4-9479-3c56b2e54386-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.271216 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.271046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp9rc\" (UniqueName: \"kubernetes.io/projected/a84378e0-7397-47b4-9479-3c56b2e54386-kube-api-access-rp9rc\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.271216 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.271097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a84378e0-7397-47b4-9479-3c56b2e54386-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.271216 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.271154 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84378e0-7397-47b4-9479-3c56b2e54386-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.372108 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.372018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a84378e0-7397-47b4-9479-3c56b2e54386-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.372108 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.372063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp9rc\" (UniqueName: \"kubernetes.io/projected/a84378e0-7397-47b4-9479-3c56b2e54386-kube-api-access-rp9rc\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.372338 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.372119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a84378e0-7397-47b4-9479-3c56b2e54386-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.372338 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.372148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84378e0-7397-47b4-9479-3c56b2e54386-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.372936 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.372908 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84378e0-7397-47b4-9479-3c56b2e54386-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.374889 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.374862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a84378e0-7397-47b4-9479-3c56b2e54386-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.375003 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.374960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a84378e0-7397-47b4-9479-3c56b2e54386-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.384824 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.384797 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp9rc\" (UniqueName: \"kubernetes.io/projected/a84378e0-7397-47b4-9479-3c56b2e54386-kube-api-access-rp9rc\") pod \"prometheus-operator-758d7cb874-6qp98\" (UID: \"a84378e0-7397-47b4-9479-3c56b2e54386\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.446831 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.446788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" Jul 31 09:32:15.647172 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:15.647101 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-6qp98"] Jul 31 09:32:15.650253 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:32:15.650224 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84378e0_7397_47b4_9479_3c56b2e54386.slice/crio-4b324978c37471c9cb37f970e97cb5ea6043f0955f952acfb9fcc61ae5e86e1c WatchSource:0}: Error finding container 4b324978c37471c9cb37f970e97cb5ea6043f0955f952acfb9fcc61ae5e86e1c: Status 404 returned error can't find the container with id 4b324978c37471c9cb37f970e97cb5ea6043f0955f952acfb9fcc61ae5e86e1c Jul 31 09:32:16.644426 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:16.644358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" event={"ID":"a84378e0-7397-47b4-9479-3c56b2e54386","Type":"ContainerStarted","Data":"4b324978c37471c9cb37f970e97cb5ea6043f0955f952acfb9fcc61ae5e86e1c"} Jul 31 09:32:17.651981 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:17.651927 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" podUID="da10bd2c-f001-4d3e-8b1d-ebaa223a9485" containerName="registry" containerID="cri-o://edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662" gracePeriod=30 Jul 31 09:32:17.968944 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:17.968914 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:32:18.096830 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.096797 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-image-registry-private-configuration\") pod \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " Jul 31 09:32:18.097001 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.096837 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-installation-pull-secrets\") pod \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " Jul 31 09:32:18.097001 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.096876 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-trusted-ca\") pod \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " Jul 31 09:32:18.097001 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.096912 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") pod \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " Jul 31 09:32:18.097001 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.096944 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-certificates\") pod \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " Jul 31 09:32:18.097001 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.096998 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7kt9\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-kube-api-access-q7kt9\") pod \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " Jul 31 09:32:18.097257 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.097060 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-ca-trust-extracted\") pod \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " Jul 31 09:32:18.097257 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.097094 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-bound-sa-token\") pod \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\" (UID: \"da10bd2c-f001-4d3e-8b1d-ebaa223a9485\") " Jul 31 09:32:18.098311 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.098049 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "da10bd2c-f001-4d3e-8b1d-ebaa223a9485" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:32:18.100412 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.100376 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "da10bd2c-f001-4d3e-8b1d-ebaa223a9485" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 09:32:18.100859 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.100832 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "da10bd2c-f001-4d3e-8b1d-ebaa223a9485" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 09:32:18.100971 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.100924 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "da10bd2c-f001-4d3e-8b1d-ebaa223a9485" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:32:18.101043 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.101020 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "da10bd2c-f001-4d3e-8b1d-ebaa223a9485" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:32:18.101407 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.101381 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "da10bd2c-f001-4d3e-8b1d-ebaa223a9485" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:32:18.101769 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.101743 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-kube-api-access-q7kt9" (OuterVolumeSpecName: "kube-api-access-q7kt9") pod "da10bd2c-f001-4d3e-8b1d-ebaa223a9485" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485"). InnerVolumeSpecName "kube-api-access-q7kt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 09:32:18.109775 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.109749 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "da10bd2c-f001-4d3e-8b1d-ebaa223a9485" (UID: "da10bd2c-f001-4d3e-8b1d-ebaa223a9485"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 09:32:18.198307 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.198236 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-ca-trust-extracted\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:18.198307 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.198265 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-bound-sa-token\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:18.198530 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.198375 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-image-registry-private-configuration\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:18.198530 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.198403 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-installation-pull-secrets\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:18.198530 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.198416 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-trusted-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:18.198530 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.198424 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:18.198530 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.198436 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-registry-certificates\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:18.198530 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.198450 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7kt9\" (UniqueName: \"kubernetes.io/projected/da10bd2c-f001-4d3e-8b1d-ebaa223a9485-kube-api-access-q7kt9\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:18.657043 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.657005 2578 generic.go:356] "Generic (PLEG): container finished" podID="da10bd2c-f001-4d3e-8b1d-ebaa223a9485" containerID="edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662" exitCode=0 Jul 31 09:32:18.657522 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.657063 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" Jul 31 09:32:18.657522 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.657099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" event={"ID":"da10bd2c-f001-4d3e-8b1d-ebaa223a9485","Type":"ContainerDied","Data":"edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662"} Jul 31 09:32:18.657522 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.657164 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9c9ddb47-qfnvl" event={"ID":"da10bd2c-f001-4d3e-8b1d-ebaa223a9485","Type":"ContainerDied","Data":"81b9d84218da9e3b37f06abb15293345eb5bc2a963e4641b49ff14e12f017113"} Jul 31 09:32:18.657522 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.657197 2578 scope.go:117] "RemoveContainer" containerID="edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662" Jul 31 09:32:18.659502 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.659419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" event={"ID":"a84378e0-7397-47b4-9479-3c56b2e54386","Type":"ContainerStarted","Data":"b66ab6f65e2f44ab661c74f53c8ee303fe25284ade52ae8857c12cbbbd4e1ae4"} Jul 31 09:32:18.659502 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.659468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" event={"ID":"a84378e0-7397-47b4-9479-3c56b2e54386","Type":"ContainerStarted","Data":"01a7f955a095f8dc555f3fee985ffd23f0be61e09518af2d986738a91c3d699e"} Jul 31 09:32:18.667464 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.667422 2578 scope.go:117] "RemoveContainer" containerID="edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662" Jul 31 09:32:18.667966 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:32:18.667929 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662\": container with ID starting with edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662 not found: ID does not exist" containerID="edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662" Jul 31 09:32:18.668096 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.667961 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662"} err="failed to get container status \"edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662\": rpc error: code = NotFound desc = could not find container \"edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662\": container with ID starting with edb2885bdb91bfbb81c5e40590d0eb5b02967892eff761ef659bcfc74f6c1662 not found: ID does not exist" Jul 31 09:32:18.683449 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.683406 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-6qp98" podStartSLOduration=1.692939027 podStartE2EDuration="3.683392428s" totalImagesPullingTime="1.990453401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:18.68243897 +0000 UTC m=+90.088969119" watchObservedRunningTime="2026-07-31 09:32:18.683392428 +0000 UTC m=+90.089922558" Jul 31 09:32:18.699928 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.699908 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d9c9ddb47-qfnvl"] Jul 31 09:32:18.709447 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:18.709425 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d9c9ddb47-qfnvl"] Jul 31 09:32:19.089925 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:19.089898 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da10bd2c-f001-4d3e-8b1d-ebaa223a9485" path="/var/lib/kubelet/pods/da10bd2c-f001-4d3e-8b1d-ebaa223a9485/volumes" Jul 31 09:32:20.529636 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.529598 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb"] Jul 31 09:32:20.530555 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.530527 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da10bd2c-f001-4d3e-8b1d-ebaa223a9485" containerName="registry" Jul 31 09:32:20.530667 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.530577 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="da10bd2c-f001-4d3e-8b1d-ebaa223a9485" containerName="registry" Jul 31 09:32:20.530740 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.530667 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="da10bd2c-f001-4d3e-8b1d-ebaa223a9485" containerName="registry" Jul 31 09:32:20.568253 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.568220 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb"] Jul 31 09:32:20.568415 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.568358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.572091 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.572061 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 31 09:32:20.573907 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.573878 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 31 09:32:20.574130 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.574110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9xvjg\"" Jul 31 09:32:20.574205 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.574185 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 31 09:32:20.610073 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.610052 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mwqvf"] Jul 31 09:32:20.627734 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.627714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.631865 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.631837 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 31 09:32:20.632021 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.631911 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 31 09:32:20.632199 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.632065 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f8cj2\"" Jul 31 09:32:20.632583 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.632562 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 31 09:32:20.718835 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.718802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2wmh\" (UniqueName: \"kubernetes.io/projected/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-kube-api-access-w2wmh\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.719094 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-wtmp\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.719214 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1aa38323-5532-4744-bc15-cc17dc17845f-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.719214 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aa38323-5532-4744-bc15-cc17dc17845f-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.719214 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1aa38323-5532-4744-bc15-cc17dc17845f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.719373 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.719373 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-tls\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.719373 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-root\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.719373 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.719373 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-textfile\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.719643 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-metrics-client-ca\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.719643 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fp5b\" (UniqueName: \"kubernetes.io/projected/1aa38323-5532-4744-bc15-cc17dc17845f-kube-api-access-5fp5b\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.719643 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-sys\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.719643 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aa38323-5532-4744-bc15-cc17dc17845f-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.719643 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.719586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1aa38323-5532-4744-bc15-cc17dc17845f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.819648 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.819562 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdf7d4cd8-m428c"] Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-sys\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aa38323-5532-4744-bc15-cc17dc17845f-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1aa38323-5532-4744-bc15-cc17dc17845f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2wmh\" (UniqueName: \"kubernetes.io/projected/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-kube-api-access-w2wmh\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-wtmp\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1aa38323-5532-4744-bc15-cc17dc17845f-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aa38323-5532-4744-bc15-cc17dc17845f-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1aa38323-5532-4744-bc15-cc17dc17845f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-tls\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-root\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-textfile\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-metrics-client-ca\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.820970 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.820749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fp5b\" (UniqueName: \"kubernetes.io/projected/1aa38323-5532-4744-bc15-cc17dc17845f-kube-api-access-5fp5b\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.821808 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.821104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-sys\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.821879 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.821850 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1aa38323-5532-4744-bc15-cc17dc17845f-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.822121 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.822097 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-root\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.823142 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:32:20.822780 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 31 09:32:20.823142 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:32:20.822841 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-tls podName:8bc7f171-591b-47a8-99a5-ed54dd3c4fd4 nodeName:}" failed. No retries permitted until 2026-07-31 09:32:21.322819894 +0000 UTC m=+92.729350013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-tls") pod "node-exporter-mwqvf" (UID: "8bc7f171-591b-47a8-99a5-ed54dd3c4fd4") : secret "node-exporter-tls" not found Jul 31 09:32:20.823142 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.823097 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-textfile\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.824702 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.823405 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.824702 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.823521 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-wtmp\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.824702 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.824030 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1aa38323-5532-4744-bc15-cc17dc17845f-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.824702 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.824069 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1aa38323-5532-4744-bc15-cc17dc17845f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.824702 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.824569 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-metrics-client-ca\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.827442 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.827415 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aa38323-5532-4744-bc15-cc17dc17845f-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.828117 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.828096 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.841556 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.841153 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fp5b\" (UniqueName: \"kubernetes.io/projected/1aa38323-5532-4744-bc15-cc17dc17845f-kube-api-access-5fp5b\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.844668 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.844623 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2wmh\" (UniqueName: \"kubernetes.io/projected/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-kube-api-access-w2wmh\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:20.846744 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.846695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1aa38323-5532-4744-bc15-cc17dc17845f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-85qsb\" (UID: \"1aa38323-5532-4744-bc15-cc17dc17845f\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:20.883468 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:20.883428 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" Jul 31 09:32:21.112130 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.112089 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb"] Jul 31 09:32:21.116467 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:32:21.116415 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa38323_5532_4744_bc15_cc17dc17845f.slice/crio-8ca73604d090e8f955de7eaca1a6618e301b8b6cfdd76150764b7de22ba1c306 WatchSource:0}: Error finding container 8ca73604d090e8f955de7eaca1a6618e301b8b6cfdd76150764b7de22ba1c306: Status 404 returned error can't find the container with id 8ca73604d090e8f955de7eaca1a6618e301b8b6cfdd76150764b7de22ba1c306 Jul 31 09:32:21.327876 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.327824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-tls\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:21.330990 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.330970 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bc7f171-591b-47a8-99a5-ed54dd3c4fd4-node-exporter-tls\") pod \"node-exporter-mwqvf\" (UID: \"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4\") " pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:21.540662 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.540571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mwqvf" Jul 31 09:32:21.572134 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.572099 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 09:32:21.582328 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:32:21.582286 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc7f171_591b_47a8_99a5_ed54dd3c4fd4.slice/crio-6d3543baf611eed86c7a058d64ca1f3c4534a2c471420522292dcc83031630e3 WatchSource:0}: Error finding container 6d3543baf611eed86c7a058d64ca1f3c4534a2c471420522292dcc83031630e3: Status 404 returned error can't find the container with id 6d3543baf611eed86c7a058d64ca1f3c4534a2c471420522292dcc83031630e3 Jul 31 09:32:21.602396 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.602366 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 09:32:21.602567 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.602502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.605644 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.605617 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 31 09:32:21.605644 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.605639 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 31 09:32:21.605802 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.605671 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4jssk\"" Jul 31 09:32:21.605971 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.605954 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 31 09:32:21.606033 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.605979 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 31 09:32:21.606516 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.606497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 31 09:32:21.606626 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.606512 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 31 09:32:21.606626 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.606523 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 31 09:32:21.606626 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.606538 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 31 09:32:21.606626 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.606501 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 31 09:32:21.673736 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.673693 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mwqvf" event={"ID":"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4","Type":"ContainerStarted","Data":"6d3543baf611eed86c7a058d64ca1f3c4534a2c471420522292dcc83031630e3"} Jul 31 09:32:21.675026 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.674999 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" event={"ID":"1aa38323-5532-4744-bc15-cc17dc17845f","Type":"ContainerStarted","Data":"8ca73604d090e8f955de7eaca1a6618e301b8b6cfdd76150764b7de22ba1c306"} Jul 31 09:32:21.730950 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.730921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.730950 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.730953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-web-config\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.730981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxj5w\" (UniqueName: \"kubernetes.io/projected/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-kube-api-access-wxj5w\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-config-out\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731357 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731357 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731357 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731357 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731269 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731357 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.731357 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.731307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.831952 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.831872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.831952 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.831930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-web-config\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832170 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.831977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxj5w\" (UniqueName: \"kubernetes.io/projected/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-kube-api-access-wxj5w\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832170 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832170 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832170 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-config-out\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832170 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832170 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832170 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832515 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832515 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832515 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832515 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.832515 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:32:21.832492 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-alertmanager-trusted-ca-bundle podName:ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4 nodeName:}" failed. No retries permitted until 2026-07-31 09:32:22.332468538 +0000 UTC m=+93.738998646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4") : configmap references non-existent config key: ca-bundle.crt Jul 31 09:32:21.832992 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.832966 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.834467 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:32:21.834063 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 31 09:32:21.834467 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:32:21.834143 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-main-tls podName:ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4 nodeName:}" failed. No retries permitted until 2026-07-31 09:32:22.33412599 +0000 UTC m=+93.740656109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4") : secret "alertmanager-main-tls" not found Jul 31 09:32:21.836066 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.835654 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.836066 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.836032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.836350 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.836324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.837349 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.837325 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-config-out\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.838538 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.838231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.838538 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.838504 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-web-config\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.838966 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.838924 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.840176 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.840151 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.840529 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.840506 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:21.847092 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:21.847074 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxj5w\" (UniqueName: \"kubernetes.io/projected/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-kube-api-access-wxj5w\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:22.337746 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:22.337703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:22.338010 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:22.337784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:22.338938 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:22.338906 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:22.341902 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:22.341872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:22.512407 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:22.512372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 09:32:23.409211 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.409183 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 09:32:23.591119 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.591091 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-566cc79cdc-thmpp"] Jul 31 09:32:23.602770 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.602752 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.606599 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.606578 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 31 09:32:23.607083 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.607062 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 31 09:32:23.607189 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.607082 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qkbhx\"" Jul 31 09:32:23.607189 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.607117 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 31 09:32:23.607189 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.607129 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-57bhomsk3b4s5\"" Jul 31 09:32:23.608292 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.608269 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 31 09:32:23.608292 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.608288 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 31 09:32:23.635120 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.635028 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-566cc79cdc-thmpp"] Jul 31 09:32:23.684383 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.684348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" event={"ID":"1aa38323-5532-4744-bc15-cc17dc17845f","Type":"ContainerStarted","Data":"e4e9fba54d41b1caf9bd8730c58f46ee98112ccb312ef8cc012bf52f93c06094"} Jul 31 09:32:23.684634 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.684420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" event={"ID":"1aa38323-5532-4744-bc15-cc17dc17845f","Type":"ContainerStarted","Data":"fe53279a9a43e515a15d70e2ed47df2a9d799497ddaefb38427b5b17b9ff6a8c"} Jul 31 09:32:23.684634 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.684454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" event={"ID":"1aa38323-5532-4744-bc15-cc17dc17845f","Type":"ContainerStarted","Data":"5afa39dd625e7d11176ed84429ba99fc35ef8de9fee131a086f7e8796d7bc2ae"} Jul 31 09:32:23.686769 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.686742 2578 generic.go:356] "Generic (PLEG): container finished" podID="8bc7f171-591b-47a8-99a5-ed54dd3c4fd4" containerID="6174bb54b30c11ebbcb0039deed218c72101ce2819ef6aaa3f4b1b6684106537" exitCode=0 Jul 31 09:32:23.686899 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.686825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mwqvf" event={"ID":"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4","Type":"ContainerDied","Data":"6174bb54b30c11ebbcb0039deed218c72101ce2819ef6aaa3f4b1b6684106537"} Jul 31 09:32:23.689930 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.689801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4","Type":"ContainerStarted","Data":"247e7c89193a79ef3820a0f41093f039bc244b0b0babc5af41fd40a136cd797a"} Jul 31 09:32:23.746027 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.745985 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-85qsb" podStartSLOduration=1.595445796 podStartE2EDuration="3.745969509s" totalImagesPullingTime="2.150523713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:23.744917761 +0000 UTC m=+95.151447890" watchObservedRunningTime="2026-07-31 09:32:23.745969509 +0000 UTC m=+95.152499638" Jul 31 09:32:23.751564 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.748864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.751564 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.748916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.751564 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.748951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-grpc-tls\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.751564 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.749003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-tls\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.751564 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.749031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.751564 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.749061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl5kn\" (UniqueName: \"kubernetes.io/projected/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-kube-api-access-gl5kn\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.751564 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.749106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-metrics-client-ca\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.751564 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.749152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.850310 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.850284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-tls\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.850440 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.850321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.850440 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.850349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl5kn\" (UniqueName: \"kubernetes.io/projected/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-kube-api-access-gl5kn\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.850440 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.850408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-metrics-client-ca\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.850644 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.850476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.850644 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.850590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.850644 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.850621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.850800 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.850646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-grpc-tls\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.853019 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.852777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-metrics-client-ca\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.853152 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.853128 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-tls\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.853529 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.853501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.854314 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.854289 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.854409 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.854341 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.854906 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.854884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.855116 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.855101 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-secret-grpc-tls\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.863813 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.863796 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl5kn\" (UniqueName: \"kubernetes.io/projected/b3aed2f4-ef44-4302-a15d-d57e4a4dea06-kube-api-access-gl5kn\") pod \"thanos-querier-566cc79cdc-thmpp\" (UID: \"b3aed2f4-ef44-4302-a15d-d57e4a4dea06\") " pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:23.915016 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:23.914786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:24.096763 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:24.096720 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-566cc79cdc-thmpp"] Jul 31 09:32:24.100223 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:32:24.100193 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3aed2f4_ef44_4302_a15d_d57e4a4dea06.slice/crio-b18685a808fb94b8d0636c0d961bb9e4cd93c8e3f733dbc9e8e501b4d7535ccb WatchSource:0}: Error finding container b18685a808fb94b8d0636c0d961bb9e4cd93c8e3f733dbc9e8e501b4d7535ccb: Status 404 returned error can't find the container with id b18685a808fb94b8d0636c0d961bb9e4cd93c8e3f733dbc9e8e501b4d7535ccb Jul 31 09:32:24.695947 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:24.695907 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mwqvf" event={"ID":"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4","Type":"ContainerStarted","Data":"762e32ae6cf138241dbf0dd46ed543b4a6eaf0ce011ae133439d2dbcae05e5bf"} Jul 31 09:32:24.696343 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:24.695974 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mwqvf" event={"ID":"8bc7f171-591b-47a8-99a5-ed54dd3c4fd4","Type":"ContainerStarted","Data":"8e1d1dc4e2a9fa36590df6105e1234f33f312aa4e5e362acfe84653326bdd9c3"} Jul 31 09:32:24.697127 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:24.697104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" event={"ID":"b3aed2f4-ef44-4302-a15d-d57e4a4dea06","Type":"ContainerStarted","Data":"b18685a808fb94b8d0636c0d961bb9e4cd93c8e3f733dbc9e8e501b4d7535ccb"} Jul 31 09:32:24.719807 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:24.719760 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mwqvf" podStartSLOduration=2.930280496 podStartE2EDuration="4.719745612s" totalImagesPullingTime="1.686490564s" totalInitContainerRuntime="102.974552ms" isStatefulPod=true podCreationTimestamp="2026-07-31 09:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:24.718650875 +0000 UTC m=+96.125181039" watchObservedRunningTime="2026-07-31 09:32:24.719745612 +0000 UTC m=+96.126275740" Jul 31 09:32:24.982775 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:24.982751 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6884fb7b98-cksbx"] Jul 31 09:32:25.000768 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.000742 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6884fb7b98-cksbx"] Jul 31 09:32:25.000916 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.000857 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.004176 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.004154 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 31 09:32:25.004682 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.004442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7wdcn\"" Jul 31 09:32:25.004682 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.004505 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 31 09:32:25.004854 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.004700 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 31 09:32:25.004854 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.004799 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 31 09:32:25.005354 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.005334 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3jgk0dut0c3kl\"" Jul 31 09:32:25.163148 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.163109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f06bc4e9-cd18-4b4e-a593-98688c88b925-metrics-server-audit-profiles\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.163359 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.163193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgg9t\" (UniqueName: \"kubernetes.io/projected/f06bc4e9-cd18-4b4e-a593-98688c88b925-kube-api-access-vgg9t\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.163359 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.163228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f06bc4e9-cd18-4b4e-a593-98688c88b925-secret-metrics-server-tls\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.163359 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.163264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06bc4e9-cd18-4b4e-a593-98688c88b925-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.163359 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.163324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f06bc4e9-cd18-4b4e-a593-98688c88b925-client-ca-bundle\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.163569 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.163423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f06bc4e9-cd18-4b4e-a593-98688c88b925-audit-log\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.163569 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.163478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f06bc4e9-cd18-4b4e-a593-98688c88b925-secret-metrics-server-client-certs\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.264591 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.264505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06bc4e9-cd18-4b4e-a593-98688c88b925-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.264591 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.264572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f06bc4e9-cd18-4b4e-a593-98688c88b925-client-ca-bundle\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.264781 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.264611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f06bc4e9-cd18-4b4e-a593-98688c88b925-audit-log\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.264781 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.264637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f06bc4e9-cd18-4b4e-a593-98688c88b925-secret-metrics-server-client-certs\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.264781 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.264672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f06bc4e9-cd18-4b4e-a593-98688c88b925-metrics-server-audit-profiles\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.264781 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.264733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgg9t\" (UniqueName: \"kubernetes.io/projected/f06bc4e9-cd18-4b4e-a593-98688c88b925-kube-api-access-vgg9t\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.264781 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.264768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f06bc4e9-cd18-4b4e-a593-98688c88b925-secret-metrics-server-tls\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.265330 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.265274 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06bc4e9-cd18-4b4e-a593-98688c88b925-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.265901 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.265875 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f06bc4e9-cd18-4b4e-a593-98688c88b925-audit-log\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.266040 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.266017 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f06bc4e9-cd18-4b4e-a593-98688c88b925-metrics-server-audit-profiles\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.268255 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.268214 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f06bc4e9-cd18-4b4e-a593-98688c88b925-secret-metrics-server-tls\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.268672 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.268427 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f06bc4e9-cd18-4b4e-a593-98688c88b925-secret-metrics-server-client-certs\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.268672 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.268445 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f06bc4e9-cd18-4b4e-a593-98688c88b925-client-ca-bundle\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.275057 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.275036 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66fc87589f-wjck2"] Jul 31 09:32:25.284135 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.284117 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgg9t\" (UniqueName: \"kubernetes.io/projected/f06bc4e9-cd18-4b4e-a593-98688c88b925-kube-api-access-vgg9t\") pod \"metrics-server-6884fb7b98-cksbx\" (UID: \"f06bc4e9-cd18-4b4e-a593-98688c88b925\") " pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.300187 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.300154 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fc87589f-wjck2"] Jul 31 09:32:25.300322 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.300263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.313758 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.313740 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:25.319684 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.319661 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 31 09:32:25.467011 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.466979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-trusted-ca-bundle\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.467174 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.467087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-serving-cert\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.467174 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.467121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-service-ca\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.467174 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.467152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-oauth-config\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.467453 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.467180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-oauth-serving-cert\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.467453 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.467275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tdx8\" (UniqueName: \"kubernetes.io/projected/0dd00100-164b-4ad6-92d6-b0457db5a907-kube-api-access-2tdx8\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.467453 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.467313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-console-config\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.473985 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.473796 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6884fb7b98-cksbx"] Jul 31 09:32:25.476299 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:32:25.476275 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06bc4e9_cd18_4b4e_a593_98688c88b925.slice/crio-c2d838614f3d06919934e161089d960e2468743f34a7d0859bfe07fb1ebcf292 WatchSource:0}: Error finding container c2d838614f3d06919934e161089d960e2468743f34a7d0859bfe07fb1ebcf292: Status 404 returned error can't find the container with id c2d838614f3d06919934e161089d960e2468743f34a7d0859bfe07fb1ebcf292 Jul 31 09:32:25.568829 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.568736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-trusted-ca-bundle\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.568829 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.568824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-serving-cert\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.569044 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.568851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-service-ca\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.569044 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.568880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-oauth-config\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.569044 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.568905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-oauth-serving-cert\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.569044 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.568968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tdx8\" (UniqueName: \"kubernetes.io/projected/0dd00100-164b-4ad6-92d6-b0457db5a907-kube-api-access-2tdx8\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.569044 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.569003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-console-config\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.569987 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.569916 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-trusted-ca-bundle\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.571971 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.571950 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-serving-cert\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.572922 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.572897 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-service-ca\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.574227 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.574186 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-oauth-config\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.574399 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.574353 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-oauth-serving-cert\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.574783 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.574762 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-console-config\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.579289 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.579265 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tdx8\" (UniqueName: \"kubernetes.io/projected/0dd00100-164b-4ad6-92d6-b0457db5a907-kube-api-access-2tdx8\") pod \"console-66fc87589f-wjck2\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.612191 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.612159 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:25.704578 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.704492 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" event={"ID":"f06bc4e9-cd18-4b4e-a593-98688c88b925","Type":"ContainerStarted","Data":"c2d838614f3d06919934e161089d960e2468743f34a7d0859bfe07fb1ebcf292"} Jul 31 09:32:25.707684 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.706868 2578 generic.go:356] "Generic (PLEG): container finished" podID="ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4" containerID="24cbe1831ae91012df2b5943fafd442469fa3fa10ab4be58c32fb793650456a8" exitCode=0 Jul 31 09:32:25.709103 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.708857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4","Type":"ContainerDied","Data":"24cbe1831ae91012df2b5943fafd442469fa3fa10ab4be58c32fb793650456a8"} Jul 31 09:32:25.759051 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.759020 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b56858bfc-xfbc7"] Jul 31 09:32:25.786732 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.786699 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b56858bfc-xfbc7"] Jul 31 09:32:25.786873 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.786800 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:25.789798 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.789776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 31 09:32:25.789917 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.789806 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 31 09:32:25.790047 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.790031 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zggp7\"" Jul 31 09:32:25.790096 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.790033 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 31 09:32:25.790096 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.790070 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 31 09:32:25.791314 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.791293 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 31 09:32:25.795671 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.795652 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 31 09:32:25.800396 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.800379 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66fc87589f-wjck2"] Jul 31 09:32:25.802891 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:32:25.802871 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd00100_164b_4ad6_92d6_b0457db5a907.slice/crio-3456fa6b9999f15b19bcaf6f5dde583bc7d2749f39e15ff86693487a4b8e4025 WatchSource:0}: Error finding container 3456fa6b9999f15b19bcaf6f5dde583bc7d2749f39e15ff86693487a4b8e4025: Status 404 returned error can't find the container with id 3456fa6b9999f15b19bcaf6f5dde583bc7d2749f39e15ff86693487a4b8e4025 Jul 31 09:32:25.973205 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.973171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-secret-telemeter-client\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:25.973205 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.973211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-federate-client-tls\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:25.973437 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.973243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:25.973437 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.973321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-telemeter-client-tls\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:25.973437 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.973355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knv8r\" (UniqueName: \"kubernetes.io/projected/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-kube-api-access-knv8r\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:25.973437 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.973385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:25.973437 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.973431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-serving-certs-ca-bundle\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:25.973718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:25.973461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-metrics-client-ca\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.074477 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.074398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-telemeter-client-tls\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.074477 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.074438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knv8r\" (UniqueName: \"kubernetes.io/projected/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-kube-api-access-knv8r\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.074708 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.074572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.074708 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.074638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-serving-certs-ca-bundle\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.074708 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.074671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-metrics-client-ca\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.074860 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.074726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-secret-telemeter-client\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.074860 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.074752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-federate-client-tls\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.074860 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.074796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.075500 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.075448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-serving-certs-ca-bundle\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.075815 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.075752 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.075954 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.075897 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-metrics-client-ca\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.077346 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.077323 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.077566 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.077519 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-telemeter-client-tls\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.077876 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.077852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-federate-client-tls\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.078072 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.078055 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-secret-telemeter-client\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.084342 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.084321 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knv8r\" (UniqueName: \"kubernetes.io/projected/d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc-kube-api-access-knv8r\") pod \"telemeter-client-7b56858bfc-xfbc7\" (UID: \"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc\") " pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.097661 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.097645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" Jul 31 09:32:26.608093 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.608051 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b56858bfc-xfbc7"] Jul 31 09:32:26.611258 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:32:26.611229 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b5231f_0ba7_4b7b_8df6_29d2d4e0bfdc.slice/crio-dc5b87374d74f6b9d174d84aea6c3f9a004ce8de6f61051bb359b68112ea4a33 WatchSource:0}: Error finding container dc5b87374d74f6b9d174d84aea6c3f9a004ce8de6f61051bb359b68112ea4a33: Status 404 returned error can't find the container with id dc5b87374d74f6b9d174d84aea6c3f9a004ce8de6f61051bb359b68112ea4a33 Jul 31 09:32:26.713043 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.712960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" event={"ID":"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc","Type":"ContainerStarted","Data":"dc5b87374d74f6b9d174d84aea6c3f9a004ce8de6f61051bb359b68112ea4a33"} Jul 31 09:32:26.714674 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.714651 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fc87589f-wjck2" event={"ID":"0dd00100-164b-4ad6-92d6-b0457db5a907","Type":"ContainerStarted","Data":"6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20"} Jul 31 09:32:26.714793 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.714689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fc87589f-wjck2" event={"ID":"0dd00100-164b-4ad6-92d6-b0457db5a907","Type":"ContainerStarted","Data":"3456fa6b9999f15b19bcaf6f5dde583bc7d2749f39e15ff86693487a4b8e4025"} Jul 31 09:32:26.743006 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:26.742960 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66fc87589f-wjck2" podStartSLOduration=1.742944011 podStartE2EDuration="1.742944011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:26.741255747 +0000 UTC m=+98.147785892" watchObservedRunningTime="2026-07-31 09:32:26.742944011 +0000 UTC m=+98.149474140" Jul 31 09:32:27.722835 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:27.722801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" event={"ID":"b3aed2f4-ef44-4302-a15d-d57e4a4dea06","Type":"ContainerStarted","Data":"a08ea9c5188df9be7051fa5c0722fdcbad5799539ccee49ddcb63cd06aa9cdbb"} Jul 31 09:32:27.723396 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:27.722874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" event={"ID":"b3aed2f4-ef44-4302-a15d-d57e4a4dea06","Type":"ContainerStarted","Data":"8ae9a9eec7061ea45998d45ac2ae250c02dfc5a58388d82d271be7824d25e584"} Jul 31 09:32:27.723396 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:27.722902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" event={"ID":"b3aed2f4-ef44-4302-a15d-d57e4a4dea06","Type":"ContainerStarted","Data":"8f77ceb0876b06f5bcf0a0e42b5c77547568c9a909ed91a364e9e562f6e5d333"} Jul 31 09:32:30.736772 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.736698 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" event={"ID":"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc","Type":"ContainerStarted","Data":"70781ad5045adaacae8056cfa7af3e5fc9b5a07a88ce39370e92f1982b8cd437"} Jul 31 09:32:30.737195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.736802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" event={"ID":"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc","Type":"ContainerStarted","Data":"6ca563052cbf4cb56c0cfca56ec6aa9ca9bd133582c69c8276a56b75a1cc4994"} Jul 31 09:32:30.737195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.736833 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" event={"ID":"d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc","Type":"ContainerStarted","Data":"9c85095a98e0f3db5c70ae6a014e77edbdb2d49e661eb115a94a95ba494f87c6"} Jul 31 09:32:30.739810 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.739784 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" event={"ID":"b3aed2f4-ef44-4302-a15d-d57e4a4dea06","Type":"ContainerStarted","Data":"de58fdb3688e1f74f0db7659f695fddff6bbc81e9a75a890dfadc08942e06e37"} Jul 31 09:32:30.739940 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.739845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" event={"ID":"b3aed2f4-ef44-4302-a15d-d57e4a4dea06","Type":"ContainerStarted","Data":"9d9f121dbc71dcf3228bfe6baf2119984a4cc966cb49f82a622414dc0a7b906d"} Jul 31 09:32:30.739940 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.739888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" event={"ID":"b3aed2f4-ef44-4302-a15d-d57e4a4dea06","Type":"ContainerStarted","Data":"fadf83feaf127614124351b8fb1048ca45092d25d6ef42b912817ecb916b9c9e"} Jul 31 09:32:30.739940 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.739926 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:30.741281 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.741254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" event={"ID":"f06bc4e9-cd18-4b4e-a593-98688c88b925","Type":"ContainerStarted","Data":"ca8d04f4165e6fe07243e5c7460084253933b49411024219eec89385927cbe41"} Jul 31 09:32:30.744601 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.744578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4","Type":"ContainerStarted","Data":"0501ddbb18e6447fb35eaff8bca7449c258e4b82779bf087a12a155bf71d888a"} Jul 31 09:32:30.744718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.744629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4","Type":"ContainerStarted","Data":"a3bb7171e5a4184923cbf4e906055194cd9a1560a1aaafa12b7b897fb83df769"} Jul 31 09:32:30.744718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.744653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4","Type":"ContainerStarted","Data":"dc3ab5fb291adad6f2d680be3f1bad4e765b28ecac95363ee00878c996151648"} Jul 31 09:32:30.744718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.744676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4","Type":"ContainerStarted","Data":"0a00a41b7a91ea7329a5f3fdd44f13a398b74155d0414dba7e301f851b9aa35d"} Jul 31 09:32:30.744718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.744702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4","Type":"ContainerStarted","Data":"d325de3979410e88cafe023fe5275ed960c8a3bd10c6edf90942688eb87fdeee"} Jul 31 09:32:30.744871 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.744726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4","Type":"ContainerStarted","Data":"713bf4af5d61799c369887758987a046764a436a61595eb026895834dbb92c6c"} Jul 31 09:32:30.765124 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.765071 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b56858bfc-xfbc7" podStartSLOduration=2.414142801 podStartE2EDuration="5.765057731s" totalImagesPullingTime="3.35091493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:30.764390866 +0000 UTC m=+102.170921020" watchObservedRunningTime="2026-07-31 09:32:30.765057731 +0000 UTC m=+102.171587859" Jul 31 09:32:30.797169 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.797122 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.058403409 podStartE2EDuration="9.797107784s" totalImagesPullingTime="5.721866667s" totalInitContainerRuntime="16.837708ms" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:30.796721264 +0000 UTC m=+102.203251392" watchObservedRunningTime="2026-07-31 09:32:30.797107784 +0000 UTC m=+102.203637912" Jul 31 09:32:30.827584 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.827511 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" podStartSLOduration=3.659581405 podStartE2EDuration="6.827492165s" totalImagesPullingTime="3.16791076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:30.825476994 +0000 UTC m=+102.232007125" watchObservedRunningTime="2026-07-31 09:32:30.827492165 +0000 UTC m=+102.234022296" Jul 31 09:32:30.860745 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.860697 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" podStartSLOduration=2.385049235 podStartE2EDuration="7.860682136s" totalImagesPullingTime="5.475632901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:30.860262881 +0000 UTC m=+102.266793010" watchObservedRunningTime="2026-07-31 09:32:30.860682136 +0000 UTC m=+102.267212264" Jul 31 09:32:30.908870 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.908829 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66fc87589f-wjck2"] Jul 31 09:32:30.968027 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.967994 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-565c67676f-hsp5x"] Jul 31 09:32:30.984515 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.984489 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:30.993046 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:30.993022 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-565c67676f-hsp5x"] Jul 31 09:32:31.026356 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.026329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-oauth-config\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.026506 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.026363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-trusted-ca-bundle\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.026506 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.026394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-config\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.026506 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.026482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-serving-cert\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.026709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.026510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-service-ca\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.026709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.026531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-oauth-serving-cert\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.026709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.026557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkvb2\" (UniqueName: \"kubernetes.io/projected/953982fa-6eff-4d2e-a4bc-1ceab1db1181-kube-api-access-tkvb2\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.127767 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.127735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-trusted-ca-bundle\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.127946 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.127784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-config\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.127946 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.127837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-serving-cert\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.127946 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.127855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-service-ca\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.127946 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.127911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-oauth-serving-cert\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.128168 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.127948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkvb2\" (UniqueName: \"kubernetes.io/projected/953982fa-6eff-4d2e-a4bc-1ceab1db1181-kube-api-access-tkvb2\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.128168 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.127996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-oauth-config\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.128669 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.128644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-config\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.128784 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.128731 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-oauth-serving-cert\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.128784 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.128730 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-service-ca\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.128974 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.128956 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-trusted-ca-bundle\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.130293 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.130274 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-serving-cert\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.130380 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.130337 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-oauth-config\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.144332 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.144311 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkvb2\" (UniqueName: \"kubernetes.io/projected/953982fa-6eff-4d2e-a4bc-1ceab1db1181-kube-api-access-tkvb2\") pod \"console-565c67676f-hsp5x\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.295367 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.295286 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:31.469600 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.469577 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-565c67676f-hsp5x"] Jul 31 09:32:31.472234 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:32:31.472199 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953982fa_6eff_4d2e_a4bc_1ceab1db1181.slice/crio-d548a6a7edd92ff7fed77a68e791ab58e133b224c225e63465f92ee8c99d697a WatchSource:0}: Error finding container d548a6a7edd92ff7fed77a68e791ab58e133b224c225e63465f92ee8c99d697a: Status 404 returned error can't find the container with id d548a6a7edd92ff7fed77a68e791ab58e133b224c225e63465f92ee8c99d697a Jul 31 09:32:31.751841 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.751680 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565c67676f-hsp5x" event={"ID":"953982fa-6eff-4d2e-a4bc-1ceab1db1181","Type":"ContainerStarted","Data":"6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f"} Jul 31 09:32:31.751841 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.751752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565c67676f-hsp5x" event={"ID":"953982fa-6eff-4d2e-a4bc-1ceab1db1181","Type":"ContainerStarted","Data":"d548a6a7edd92ff7fed77a68e791ab58e133b224c225e63465f92ee8c99d697a"} Jul 31 09:32:31.780176 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:31.780123 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-565c67676f-hsp5x" podStartSLOduration=1.7801081189999999 podStartE2EDuration="1.780108119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:32:31.77901227 +0000 UTC m=+103.185542399" watchObservedRunningTime="2026-07-31 09:32:31.780108119 +0000 UTC m=+103.186638248" Jul 31 09:32:33.585599 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:33.585571 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z65mq" Jul 31 09:32:35.613072 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:35.613038 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:36.758372 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:36.758335 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-566cc79cdc-thmpp" Jul 31 09:32:41.296027 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:41.295988 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:41.296694 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:41.296072 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:41.301085 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:41.301067 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:41.799880 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:41.799851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:32:45.314578 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:45.314527 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:45.314968 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:45.314602 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:32:45.860909 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:45.860873 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bdf7d4cd8-m428c" podUID="dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" containerName="console" containerID="cri-o://36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca" gracePeriod=15 Jul 31 09:32:46.131866 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.131801 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:46.266464 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.266430 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-oauth-config\") pod \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " Jul 31 09:32:46.266658 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.266481 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-service-ca\") pod \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " Jul 31 09:32:46.266658 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.266514 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-oauth-serving-cert\") pod \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " Jul 31 09:32:46.266658 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.266631 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-config\") pod \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " Jul 31 09:32:46.266829 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.266684 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccvct\" (UniqueName: \"kubernetes.io/projected/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-kube-api-access-ccvct\") pod \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " Jul 31 09:32:46.266829 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.266735 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-serving-cert\") pod \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\" (UID: \"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e\") " Jul 31 09:32:46.266932 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.266910 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" (UID: "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:32:46.266978 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.266923 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-service-ca" (OuterVolumeSpecName: "service-ca") pod "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" (UID: "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:32:46.267025 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.266995 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-config" (OuterVolumeSpecName: "console-config") pod "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" (UID: "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:32:46.267061 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.267043 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:46.267094 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.267062 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-oauth-serving-cert\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:46.268863 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.268835 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" (UID: "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:32:46.268962 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.268878 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-kube-api-access-ccvct" (OuterVolumeSpecName: "kube-api-access-ccvct") pod "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" (UID: "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e"). InnerVolumeSpecName "kube-api-access-ccvct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 09:32:46.268962 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.268905 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" (UID: "dbc3787d-4cec-4e7e-ae23-a60497fe1f3e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:32:46.368017 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.367980 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-oauth-config\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:46.368017 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.368011 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-config\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:46.368017 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.368020 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccvct\" (UniqueName: \"kubernetes.io/projected/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-kube-api-access-ccvct\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:46.368017 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.368029 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e-console-serving-cert\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:46.820915 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.820878 2578 generic.go:356] "Generic (PLEG): container finished" podID="dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" containerID="36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca" exitCode=0 Jul 31 09:32:46.820915 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.820915 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdf7d4cd8-m428c" Jul 31 09:32:46.821215 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.820955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdf7d4cd8-m428c" event={"ID":"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e","Type":"ContainerDied","Data":"36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca"} Jul 31 09:32:46.821215 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.821016 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdf7d4cd8-m428c" event={"ID":"dbc3787d-4cec-4e7e-ae23-a60497fe1f3e","Type":"ContainerDied","Data":"270f54c9e0eeba71952f6da1c6f24e50142376ec4732aa91ed8e1765e41c3622"} Jul 31 09:32:46.821215 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.821044 2578 scope.go:117] "RemoveContainer" containerID="36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca" Jul 31 09:32:46.830295 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.830280 2578 scope.go:117] "RemoveContainer" containerID="36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca" Jul 31 09:32:46.830527 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:32:46.830509 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca\": container with ID starting with 36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca not found: ID does not exist" containerID="36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca" Jul 31 09:32:46.830588 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.830536 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca"} err="failed to get container status \"36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca\": rpc error: code = NotFound desc = could not find container \"36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca\": container with ID starting with 36acdca88f6b48d80c48287a86a334a68dcf0ce14d5823a018887cb966926cca not found: ID does not exist" Jul 31 09:32:46.842905 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.842879 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdf7d4cd8-m428c"] Jul 31 09:32:46.846754 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:46.846735 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bdf7d4cd8-m428c"] Jul 31 09:32:47.090857 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:47.090834 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" path="/var/lib/kubelet/pods/dbc3787d-4cec-4e7e-ae23-a60497fe1f3e/volumes" Jul 31 09:32:55.927539 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:55.927490 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66fc87589f-wjck2" podUID="0dd00100-164b-4ad6-92d6-b0457db5a907" containerName="console" containerID="cri-o://6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20" gracePeriod=15 Jul 31 09:32:56.209393 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.209328 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:56.358105 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358074 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-serving-cert\") pod \"0dd00100-164b-4ad6-92d6-b0457db5a907\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " Jul 31 09:32:56.358283 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358120 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-trusted-ca-bundle\") pod \"0dd00100-164b-4ad6-92d6-b0457db5a907\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " Jul 31 09:32:56.358283 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358247 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-oauth-serving-cert\") pod \"0dd00100-164b-4ad6-92d6-b0457db5a907\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " Jul 31 09:32:56.358403 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358287 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-service-ca\") pod \"0dd00100-164b-4ad6-92d6-b0457db5a907\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " Jul 31 09:32:56.358403 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358313 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-console-config\") pod \"0dd00100-164b-4ad6-92d6-b0457db5a907\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " Jul 31 09:32:56.358504 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358429 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-oauth-config\") pod \"0dd00100-164b-4ad6-92d6-b0457db5a907\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " Jul 31 09:32:56.358504 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358470 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tdx8\" (UniqueName: \"kubernetes.io/projected/0dd00100-164b-4ad6-92d6-b0457db5a907-kube-api-access-2tdx8\") pod \"0dd00100-164b-4ad6-92d6-b0457db5a907\" (UID: \"0dd00100-164b-4ad6-92d6-b0457db5a907\") " Jul 31 09:32:56.358654 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358631 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0dd00100-164b-4ad6-92d6-b0457db5a907" (UID: "0dd00100-164b-4ad6-92d6-b0457db5a907"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:32:56.358710 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358653 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-service-ca" (OuterVolumeSpecName: "service-ca") pod "0dd00100-164b-4ad6-92d6-b0457db5a907" (UID: "0dd00100-164b-4ad6-92d6-b0457db5a907"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:32:56.358710 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358673 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-console-config" (OuterVolumeSpecName: "console-config") pod "0dd00100-164b-4ad6-92d6-b0457db5a907" (UID: "0dd00100-164b-4ad6-92d6-b0457db5a907"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:32:56.358846 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358823 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:56.358846 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358849 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-console-config\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:56.359028 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358863 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-trusted-ca-bundle\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:56.359028 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.358926 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0dd00100-164b-4ad6-92d6-b0457db5a907" (UID: "0dd00100-164b-4ad6-92d6-b0457db5a907"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:32:56.360234 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.360210 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0dd00100-164b-4ad6-92d6-b0457db5a907" (UID: "0dd00100-164b-4ad6-92d6-b0457db5a907"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:32:56.360513 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.360497 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0dd00100-164b-4ad6-92d6-b0457db5a907" (UID: "0dd00100-164b-4ad6-92d6-b0457db5a907"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:32:56.360792 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.360770 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd00100-164b-4ad6-92d6-b0457db5a907-kube-api-access-2tdx8" (OuterVolumeSpecName: "kube-api-access-2tdx8") pod "0dd00100-164b-4ad6-92d6-b0457db5a907" (UID: "0dd00100-164b-4ad6-92d6-b0457db5a907"). InnerVolumeSpecName "kube-api-access-2tdx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 09:32:56.460043 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.459960 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-serving-cert\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:56.460043 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.459996 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dd00100-164b-4ad6-92d6-b0457db5a907-oauth-serving-cert\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:56.460043 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.460006 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dd00100-164b-4ad6-92d6-b0457db5a907-console-oauth-config\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:56.460043 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.460014 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tdx8\" (UniqueName: \"kubernetes.io/projected/0dd00100-164b-4ad6-92d6-b0457db5a907-kube-api-access-2tdx8\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:32:56.862070 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.862039 2578 generic.go:356] "Generic (PLEG): container finished" podID="0dd00100-164b-4ad6-92d6-b0457db5a907" containerID="6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20" exitCode=0 Jul 31 09:32:56.862225 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.862086 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66fc87589f-wjck2" Jul 31 09:32:56.862225 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.862130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fc87589f-wjck2" event={"ID":"0dd00100-164b-4ad6-92d6-b0457db5a907","Type":"ContainerDied","Data":"6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20"} Jul 31 09:32:56.862225 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.862179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66fc87589f-wjck2" event={"ID":"0dd00100-164b-4ad6-92d6-b0457db5a907","Type":"ContainerDied","Data":"3456fa6b9999f15b19bcaf6f5dde583bc7d2749f39e15ff86693487a4b8e4025"} Jul 31 09:32:56.862225 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.862199 2578 scope.go:117] "RemoveContainer" containerID="6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20" Jul 31 09:32:56.870665 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.870649 2578 scope.go:117] "RemoveContainer" containerID="6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20" Jul 31 09:32:56.870907 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:32:56.870889 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20\": container with ID starting with 6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20 not found: ID does not exist" containerID="6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20" Jul 31 09:32:56.870973 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.870913 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20"} err="failed to get container status \"6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20\": rpc error: code = NotFound desc = could not find container \"6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20\": container with ID starting with 6f313f9032ec081cca3e6e223ba8d48c25d6be9baab292ea41df5a1516e93c20 not found: ID does not exist" Jul 31 09:32:56.883915 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.883894 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66fc87589f-wjck2"] Jul 31 09:32:56.888580 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:56.888554 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66fc87589f-wjck2"] Jul 31 09:32:57.089717 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:32:57.089686 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd00100-164b-4ad6-92d6-b0457db5a907" path="/var/lib/kubelet/pods/0dd00100-164b-4ad6-92d6-b0457db5a907/volumes" Jul 31 09:33:05.320279 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:05.320241 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:33:05.323932 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:05.323911 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6884fb7b98-cksbx" Jul 31 09:33:37.823645 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.823611 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7777644fdb-hx6q4"] Jul 31 09:33:37.824099 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.823922 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" containerName="console" Jul 31 09:33:37.824099 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.823933 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" containerName="console" Jul 31 09:33:37.824099 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.823947 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd00100-164b-4ad6-92d6-b0457db5a907" containerName="console" Jul 31 09:33:37.824099 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.823953 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd00100-164b-4ad6-92d6-b0457db5a907" containerName="console" Jul 31 09:33:37.824099 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.824035 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc3787d-4cec-4e7e-ae23-a60497fe1f3e" containerName="console" Jul 31 09:33:37.824099 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.824045 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd00100-164b-4ad6-92d6-b0457db5a907" containerName="console" Jul 31 09:33:37.826825 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.826809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:37.841931 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.841904 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7777644fdb-hx6q4"] Jul 31 09:33:37.922306 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.922277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-trusted-ca-bundle\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:37.922441 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.922311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-service-ca\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:37.922441 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.922342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-oauth-serving-cert\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:37.922441 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.922406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-oauth-config\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:37.922441 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.922432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssztj\" (UniqueName: \"kubernetes.io/projected/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-kube-api-access-ssztj\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:37.922595 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.922455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-serving-cert\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:37.922595 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:37.922470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-config\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.023412 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.023368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-trusted-ca-bundle\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.023412 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.023416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-service-ca\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.023718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.023441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-oauth-serving-cert\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.023718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.023459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-oauth-config\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.023718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.023474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssztj\" (UniqueName: \"kubernetes.io/projected/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-kube-api-access-ssztj\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.023718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.023497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-serving-cert\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.023718 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.023522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-config\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.024255 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.024229 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-oauth-serving-cert\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.024407 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.024373 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-config\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.024407 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.024262 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-service-ca\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.024566 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.024409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-trusted-ca-bundle\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.026037 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.026015 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-oauth-config\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.026346 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.026324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-serving-cert\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.031700 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.031680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssztj\" (UniqueName: \"kubernetes.io/projected/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-kube-api-access-ssztj\") pod \"console-7777644fdb-hx6q4\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.140783 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.140756 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:38.272380 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:38.272346 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7777644fdb-hx6q4"] Jul 31 09:33:38.275785 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:33:38.275753 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d23ffcd_35fc_4301_a0a6_6de4fa1fd6ca.slice/crio-7669b33f20c34a3a4e88c3968ba92ecc3f4c98ed1b741d5b716aa7ad57106487 WatchSource:0}: Error finding container 7669b33f20c34a3a4e88c3968ba92ecc3f4c98ed1b741d5b716aa7ad57106487: Status 404 returned error can't find the container with id 7669b33f20c34a3a4e88c3968ba92ecc3f4c98ed1b741d5b716aa7ad57106487 Jul 31 09:33:39.033679 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:39.033640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7777644fdb-hx6q4" event={"ID":"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca","Type":"ContainerStarted","Data":"b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc"} Jul 31 09:33:39.034022 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:39.033699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7777644fdb-hx6q4" event={"ID":"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca","Type":"ContainerStarted","Data":"7669b33f20c34a3a4e88c3968ba92ecc3f4c98ed1b741d5b716aa7ad57106487"} Jul 31 09:33:39.055055 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:39.054998 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7777644fdb-hx6q4" podStartSLOduration=2.054981372 podStartE2EDuration="2.054981372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:33:39.053988495 +0000 UTC m=+170.460518627" watchObservedRunningTime="2026-07-31 09:33:39.054981372 +0000 UTC m=+170.461511565" Jul 31 09:33:48.141146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:48.141059 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:48.141146 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:48.141119 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:48.146921 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:48.146182 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:49.083667 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:49.083639 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:33:49.130448 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:33:49.130421 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-565c67676f-hsp5x"] Jul 31 09:34:14.150714 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.150674 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-565c67676f-hsp5x" podUID="953982fa-6eff-4d2e-a4bc-1ceab1db1181" containerName="console" containerID="cri-o://6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f" gracePeriod=15 Jul 31 09:34:14.387176 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.387153 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:34:14.541229 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541154 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-config\") pod \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " Jul 31 09:34:14.541229 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541227 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkvb2\" (UniqueName: \"kubernetes.io/projected/953982fa-6eff-4d2e-a4bc-1ceab1db1181-kube-api-access-tkvb2\") pod \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " Jul 31 09:34:14.541444 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541245 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-trusted-ca-bundle\") pod \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " Jul 31 09:34:14.541444 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541264 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-serving-cert\") pod \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " Jul 31 09:34:14.541444 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541289 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-oauth-serving-cert\") pod \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " Jul 31 09:34:14.541444 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541325 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-oauth-config\") pod \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " Jul 31 09:34:14.541444 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541365 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-service-ca\") pod \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\" (UID: \"953982fa-6eff-4d2e-a4bc-1ceab1db1181\") " Jul 31 09:34:14.541711 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541580 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-config" (OuterVolumeSpecName: "console-config") pod "953982fa-6eff-4d2e-a4bc-1ceab1db1181" (UID: "953982fa-6eff-4d2e-a4bc-1ceab1db1181"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:34:14.541841 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541817 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "953982fa-6eff-4d2e-a4bc-1ceab1db1181" (UID: "953982fa-6eff-4d2e-a4bc-1ceab1db1181"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:34:14.541926 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541873 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-service-ca" (OuterVolumeSpecName: "service-ca") pod "953982fa-6eff-4d2e-a4bc-1ceab1db1181" (UID: "953982fa-6eff-4d2e-a4bc-1ceab1db1181"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:34:14.541926 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.541882 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "953982fa-6eff-4d2e-a4bc-1ceab1db1181" (UID: "953982fa-6eff-4d2e-a4bc-1ceab1db1181"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:34:14.543507 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.543484 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "953982fa-6eff-4d2e-a4bc-1ceab1db1181" (UID: "953982fa-6eff-4d2e-a4bc-1ceab1db1181"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:34:14.543633 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.543530 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "953982fa-6eff-4d2e-a4bc-1ceab1db1181" (UID: "953982fa-6eff-4d2e-a4bc-1ceab1db1181"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:34:14.543633 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.543570 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953982fa-6eff-4d2e-a4bc-1ceab1db1181-kube-api-access-tkvb2" (OuterVolumeSpecName: "kube-api-access-tkvb2") pod "953982fa-6eff-4d2e-a4bc-1ceab1db1181" (UID: "953982fa-6eff-4d2e-a4bc-1ceab1db1181"). InnerVolumeSpecName "kube-api-access-tkvb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 09:34:14.642632 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.642601 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkvb2\" (UniqueName: \"kubernetes.io/projected/953982fa-6eff-4d2e-a4bc-1ceab1db1181-kube-api-access-tkvb2\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:34:14.642632 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.642627 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-trusted-ca-bundle\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:34:14.642632 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.642636 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-serving-cert\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:34:14.642847 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.642644 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-oauth-serving-cert\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:34:14.642847 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.642652 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-oauth-config\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:34:14.642847 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.642661 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:34:14.642847 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:14.642670 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953982fa-6eff-4d2e-a4bc-1ceab1db1181-console-config\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:34:15.180204 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:15.180166 2578 generic.go:356] "Generic (PLEG): container finished" podID="953982fa-6eff-4d2e-a4bc-1ceab1db1181" containerID="6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f" exitCode=0 Jul 31 09:34:15.180631 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:15.180212 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565c67676f-hsp5x" Jul 31 09:34:15.180631 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:15.180219 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565c67676f-hsp5x" event={"ID":"953982fa-6eff-4d2e-a4bc-1ceab1db1181","Type":"ContainerDied","Data":"6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f"} Jul 31 09:34:15.180631 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:15.180270 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565c67676f-hsp5x" event={"ID":"953982fa-6eff-4d2e-a4bc-1ceab1db1181","Type":"ContainerDied","Data":"d548a6a7edd92ff7fed77a68e791ab58e133b224c225e63465f92ee8c99d697a"} Jul 31 09:34:15.180631 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:15.180299 2578 scope.go:117] "RemoveContainer" containerID="6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f" Jul 31 09:34:15.188295 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:15.188280 2578 scope.go:117] "RemoveContainer" containerID="6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f" Jul 31 09:34:15.188535 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:34:15.188517 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f\": container with ID starting with 6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f not found: ID does not exist" containerID="6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f" Jul 31 09:34:15.188609 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:15.188563 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f"} err="failed to get container status \"6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f\": rpc error: code = NotFound desc = could not find container \"6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f\": container with ID starting with 6c3e6f1c7ea2695e4f3068df6d97420640e7bafb4e72e81cda98b63b1e093b5f not found: ID does not exist" Jul 31 09:34:15.196640 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:15.196616 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-565c67676f-hsp5x"] Jul 31 09:34:15.198951 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:15.198928 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-565c67676f-hsp5x"] Jul 31 09:34:17.088959 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:17.088920 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="953982fa-6eff-4d2e-a4bc-1ceab1db1181" path="/var/lib/kubelet/pods/953982fa-6eff-4d2e-a4bc-1ceab1db1181/volumes" Jul 31 09:34:52.170287 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.170247 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh"] Jul 31 09:34:52.170703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.170622 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953982fa-6eff-4d2e-a4bc-1ceab1db1181" containerName="console" Jul 31 09:34:52.170703 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.170635 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="953982fa-6eff-4d2e-a4bc-1ceab1db1181" containerName="console" Jul 31 09:34:52.170777 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.170705 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="953982fa-6eff-4d2e-a4bc-1ceab1db1181" containerName="console" Jul 31 09:34:52.175041 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.175025 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" Jul 31 09:34:52.177846 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.177817 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 31 09:34:52.177846 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.177840 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nnmg6\"" Jul 31 09:34:52.178028 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.177879 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 31 09:34:52.185912 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.185886 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh"] Jul 31 09:34:52.246096 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.246058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aec0e6d-836f-4f76-a964-3b52e4da62c3-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-smnkh\" (UID: \"1aec0e6d-836f-4f76-a964-3b52e4da62c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" Jul 31 09:34:52.246259 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.246109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-626jq\" (UniqueName: \"kubernetes.io/projected/1aec0e6d-836f-4f76-a964-3b52e4da62c3-kube-api-access-626jq\") pod \"cert-manager-operator-controller-manager-56b4598547-smnkh\" (UID: \"1aec0e6d-836f-4f76-a964-3b52e4da62c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" Jul 31 09:34:52.346995 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.346961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aec0e6d-836f-4f76-a964-3b52e4da62c3-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-smnkh\" (UID: \"1aec0e6d-836f-4f76-a964-3b52e4da62c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" Jul 31 09:34:52.347188 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.347008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-626jq\" (UniqueName: \"kubernetes.io/projected/1aec0e6d-836f-4f76-a964-3b52e4da62c3-kube-api-access-626jq\") pod \"cert-manager-operator-controller-manager-56b4598547-smnkh\" (UID: \"1aec0e6d-836f-4f76-a964-3b52e4da62c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" Jul 31 09:34:52.347415 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.347393 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aec0e6d-836f-4f76-a964-3b52e4da62c3-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-smnkh\" (UID: \"1aec0e6d-836f-4f76-a964-3b52e4da62c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" Jul 31 09:34:52.356772 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.356749 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-626jq\" (UniqueName: \"kubernetes.io/projected/1aec0e6d-836f-4f76-a964-3b52e4da62c3-kube-api-access-626jq\") pod \"cert-manager-operator-controller-manager-56b4598547-smnkh\" (UID: \"1aec0e6d-836f-4f76-a964-3b52e4da62c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" Jul 31 09:34:52.484464 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.484390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" Jul 31 09:34:52.623595 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:52.623538 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh"] Jul 31 09:34:52.628847 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:34:52.628819 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aec0e6d_836f_4f76_a964_3b52e4da62c3.slice/crio-9bed64314d6662fd5efcd3a3d0655bb6cc67a44a3a64ccb1a4bf1371c0abba57 WatchSource:0}: Error finding container 9bed64314d6662fd5efcd3a3d0655bb6cc67a44a3a64ccb1a4bf1371c0abba57: Status 404 returned error can't find the container with id 9bed64314d6662fd5efcd3a3d0655bb6cc67a44a3a64ccb1a4bf1371c0abba57 Jul 31 09:34:53.331554 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:53.331516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" event={"ID":"1aec0e6d-836f-4f76-a964-3b52e4da62c3","Type":"ContainerStarted","Data":"9bed64314d6662fd5efcd3a3d0655bb6cc67a44a3a64ccb1a4bf1371c0abba57"} Jul 31 09:34:55.350258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:55.350217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" event={"ID":"1aec0e6d-836f-4f76-a964-3b52e4da62c3","Type":"ContainerStarted","Data":"2f2640ce3eb6b4e625efdd6f7b5a78d7faa9e85b0f823f05d5de61bd37baf20d"} Jul 31 09:34:55.375986 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:55.375934 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-smnkh" podStartSLOduration=0.747544039 podStartE2EDuration="3.375918851s" totalImagesPullingTime="2.628374812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:34:55.375087624 +0000 UTC m=+246.781617756" watchObservedRunningTime="2026-07-31 09:34:55.375918851 +0000 UTC m=+246.782448980" Jul 31 09:34:57.376831 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.376800 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c7xhv"] Jul 31 09:34:57.380333 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.380311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:34:57.383594 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.383574 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 31 09:34:57.384672 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.384653 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5kw9m\"" Jul 31 09:34:57.384771 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.384672 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 31 09:34:57.389937 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.389917 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c7xhv"] Jul 31 09:34:57.488622 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.488588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d37d98a6-40b9-45ec-b546-8df79bf5a736-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c7xhv\" (UID: \"d37d98a6-40b9-45ec-b546-8df79bf5a736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:34:57.488622 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.488625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjmt\" (UniqueName: \"kubernetes.io/projected/d37d98a6-40b9-45ec-b546-8df79bf5a736-kube-api-access-fsjmt\") pod \"cert-manager-webhook-6486ffd997-c7xhv\" (UID: \"d37d98a6-40b9-45ec-b546-8df79bf5a736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:34:57.589123 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.589090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d37d98a6-40b9-45ec-b546-8df79bf5a736-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c7xhv\" (UID: \"d37d98a6-40b9-45ec-b546-8df79bf5a736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:34:57.589123 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.589124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjmt\" (UniqueName: \"kubernetes.io/projected/d37d98a6-40b9-45ec-b546-8df79bf5a736-kube-api-access-fsjmt\") pod \"cert-manager-webhook-6486ffd997-c7xhv\" (UID: \"d37d98a6-40b9-45ec-b546-8df79bf5a736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:34:57.601144 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.601112 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d37d98a6-40b9-45ec-b546-8df79bf5a736-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c7xhv\" (UID: \"d37d98a6-40b9-45ec-b546-8df79bf5a736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:34:57.601286 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.601268 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjmt\" (UniqueName: \"kubernetes.io/projected/d37d98a6-40b9-45ec-b546-8df79bf5a736-kube-api-access-fsjmt\") pod \"cert-manager-webhook-6486ffd997-c7xhv\" (UID: \"d37d98a6-40b9-45ec-b546-8df79bf5a736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:34:57.689660 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.689585 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:34:57.820686 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:57.820661 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c7xhv"] Jul 31 09:34:57.822487 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:34:57.822462 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd37d98a6_40b9_45ec_b546_8df79bf5a736.slice/crio-7a1f0a14c5973feb784c3ad4ec13c523cb5a4cf4d60bedbf62d451cf1cf51a86 WatchSource:0}: Error finding container 7a1f0a14c5973feb784c3ad4ec13c523cb5a4cf4d60bedbf62d451cf1cf51a86: Status 404 returned error can't find the container with id 7a1f0a14c5973feb784c3ad4ec13c523cb5a4cf4d60bedbf62d451cf1cf51a86 Jul 31 09:34:58.366355 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:34:58.366321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" event={"ID":"d37d98a6-40b9-45ec-b546-8df79bf5a736","Type":"ContainerStarted","Data":"7a1f0a14c5973feb784c3ad4ec13c523cb5a4cf4d60bedbf62d451cf1cf51a86"} Jul 31 09:35:00.377063 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:00.377020 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" event={"ID":"d37d98a6-40b9-45ec-b546-8df79bf5a736","Type":"ContainerStarted","Data":"5b9eafbddd9b0ee8b5df104c38414ca7a42a2358a68f51ecf8d008f4f0096b64"} Jul 31 09:35:00.377426 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:00.377082 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:35:00.396300 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:00.396249 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" podStartSLOduration=0.962074257 podStartE2EDuration="3.396233908s" totalImagesPullingTime="2.434159651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:35:00.394605846 +0000 UTC m=+251.801136027" watchObservedRunningTime="2026-07-31 09:35:00.396233908 +0000 UTC m=+251.802764037" Jul 31 09:35:06.384021 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:06.383990 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c7xhv" Jul 31 09:35:07.634206 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.634167 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mzxkr"] Jul 31 09:35:07.637580 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.637562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mzxkr" Jul 31 09:35:07.640117 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.640102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jvdrl\"" Jul 31 09:35:07.649519 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.649500 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mzxkr"] Jul 31 09:35:07.777420 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.777379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/238e65ee-64c5-47f1-b81e-140ec40e5b9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-mzxkr\" (UID: \"238e65ee-64c5-47f1-b81e-140ec40e5b9f\") " pod="cert-manager/cert-manager-55b4d954d5-mzxkr" Jul 31 09:35:07.777420 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.777421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdrk8\" (UniqueName: \"kubernetes.io/projected/238e65ee-64c5-47f1-b81e-140ec40e5b9f-kube-api-access-pdrk8\") pod \"cert-manager-55b4d954d5-mzxkr\" (UID: \"238e65ee-64c5-47f1-b81e-140ec40e5b9f\") " pod="cert-manager/cert-manager-55b4d954d5-mzxkr" Jul 31 09:35:07.878189 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.878148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/238e65ee-64c5-47f1-b81e-140ec40e5b9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-mzxkr\" (UID: \"238e65ee-64c5-47f1-b81e-140ec40e5b9f\") " pod="cert-manager/cert-manager-55b4d954d5-mzxkr" Jul 31 09:35:07.878189 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.878195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdrk8\" (UniqueName: \"kubernetes.io/projected/238e65ee-64c5-47f1-b81e-140ec40e5b9f-kube-api-access-pdrk8\") pod \"cert-manager-55b4d954d5-mzxkr\" (UID: \"238e65ee-64c5-47f1-b81e-140ec40e5b9f\") " pod="cert-manager/cert-manager-55b4d954d5-mzxkr" Jul 31 09:35:07.888196 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.888139 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdrk8\" (UniqueName: \"kubernetes.io/projected/238e65ee-64c5-47f1-b81e-140ec40e5b9f-kube-api-access-pdrk8\") pod \"cert-manager-55b4d954d5-mzxkr\" (UID: \"238e65ee-64c5-47f1-b81e-140ec40e5b9f\") " pod="cert-manager/cert-manager-55b4d954d5-mzxkr" Jul 31 09:35:07.888907 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.888888 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/238e65ee-64c5-47f1-b81e-140ec40e5b9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-mzxkr\" (UID: \"238e65ee-64c5-47f1-b81e-140ec40e5b9f\") " pod="cert-manager/cert-manager-55b4d954d5-mzxkr" Jul 31 09:35:07.946088 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:07.946051 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mzxkr" Jul 31 09:35:08.074992 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:08.074883 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mzxkr"] Jul 31 09:35:08.077208 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:35:08.077183 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod238e65ee_64c5_47f1_b81e_140ec40e5b9f.slice/crio-c7a50bce8f98c506c965bf6b2178fdd752bad4077b12b236f0e8563a73204319 WatchSource:0}: Error finding container c7a50bce8f98c506c965bf6b2178fdd752bad4077b12b236f0e8563a73204319: Status 404 returned error can't find the container with id c7a50bce8f98c506c965bf6b2178fdd752bad4077b12b236f0e8563a73204319 Jul 31 09:35:08.411850 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:08.411814 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mzxkr" event={"ID":"238e65ee-64c5-47f1-b81e-140ec40e5b9f","Type":"ContainerStarted","Data":"37b33f7b0f90f87d3449a30da4401efa74840041b84c40abc0bf6c0eff6c6104"} Jul 31 09:35:08.411850 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:08.411854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mzxkr" event={"ID":"238e65ee-64c5-47f1-b81e-140ec40e5b9f","Type":"ContainerStarted","Data":"c7a50bce8f98c506c965bf6b2178fdd752bad4077b12b236f0e8563a73204319"} Jul 31 09:35:08.432375 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:08.432327 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mzxkr" podStartSLOduration=1.432311119 podStartE2EDuration="1.432311119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:35:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:35:08.430785487 +0000 UTC m=+259.837315617" watchObservedRunningTime="2026-07-31 09:35:08.432311119 +0000 UTC m=+259.838841247" Jul 31 09:35:33.379482 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.379447 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49"] Jul 31 09:35:33.385258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.385239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.389495 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.389467 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 31 09:35:33.389495 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.389488 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 31 09:35:33.389685 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.389500 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 31 09:35:33.389685 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.389563 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 31 09:35:33.389685 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.389644 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-m2cms\"" Jul 31 09:35:33.389685 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.389648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 31 09:35:33.391745 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.391698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49"] Jul 31 09:35:33.497454 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.497414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bed603e-c59d-49b1-b773-1806e120bb07-metrics-certs\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.497649 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.497475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bed603e-c59d-49b1-b773-1806e120bb07-cert\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.497649 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.497527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6bed603e-c59d-49b1-b773-1806e120bb07-manager-config\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.497740 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.497649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j4jc\" (UniqueName: \"kubernetes.io/projected/6bed603e-c59d-49b1-b773-1806e120bb07-kube-api-access-4j4jc\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.598027 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.597997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bed603e-c59d-49b1-b773-1806e120bb07-metrics-certs\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.598205 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.598047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bed603e-c59d-49b1-b773-1806e120bb07-cert\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.598324 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.598301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6bed603e-c59d-49b1-b773-1806e120bb07-manager-config\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.598439 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.598423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j4jc\" (UniqueName: \"kubernetes.io/projected/6bed603e-c59d-49b1-b773-1806e120bb07-kube-api-access-4j4jc\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.599012 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.598991 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6bed603e-c59d-49b1-b773-1806e120bb07-manager-config\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.600666 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.600645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bed603e-c59d-49b1-b773-1806e120bb07-metrics-certs\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.600741 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.600727 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bed603e-c59d-49b1-b773-1806e120bb07-cert\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.607923 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.607904 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j4jc\" (UniqueName: \"kubernetes.io/projected/6bed603e-c59d-49b1-b773-1806e120bb07-kube-api-access-4j4jc\") pod \"jobset-controller-manager-58c84b5978-rhm49\" (UID: \"6bed603e-c59d-49b1-b773-1806e120bb07\") " pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.696048 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.695982 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:33.825013 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:33.824948 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49"] Jul 31 09:35:33.827297 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:35:33.827273 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bed603e_c59d_49b1_b773_1806e120bb07.slice/crio-21ac02e967c2d5c2167e9c0858649ef349c7361784f052c2c1578303a516824f WatchSource:0}: Error finding container 21ac02e967c2d5c2167e9c0858649ef349c7361784f052c2c1578303a516824f: Status 404 returned error can't find the container with id 21ac02e967c2d5c2167e9c0858649ef349c7361784f052c2c1578303a516824f Jul 31 09:35:34.525336 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:34.525299 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" event={"ID":"6bed603e-c59d-49b1-b773-1806e120bb07","Type":"ContainerStarted","Data":"21ac02e967c2d5c2167e9c0858649ef349c7361784f052c2c1578303a516824f"} Jul 31 09:35:36.536343 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:36.536255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" event={"ID":"6bed603e-c59d-49b1-b773-1806e120bb07","Type":"ContainerStarted","Data":"8a07c4d6696768c038d800651a656f26e2005abaea32e2e864d2ede763c3facd"} Jul 31 09:35:36.536756 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:36.536371 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:36.553889 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:36.553837 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" podStartSLOduration=1.198883713 podStartE2EDuration="3.553817105s" totalImagesPullingTime="2.354933392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:35:36.552774603 +0000 UTC m=+287.959304732" watchObservedRunningTime="2026-07-31 09:35:36.553817105 +0000 UTC m=+287.960347235" Jul 31 09:35:47.546697 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:47.546661 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-58c84b5978-rhm49" Jul 31 09:35:49.015503 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:35:49.015475 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 31 09:37:23.057133 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.057100 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85b688749b-72kvk"] Jul 31 09:37:23.060238 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.060221 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.091565 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.091513 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b688749b-72kvk"] Jul 31 09:37:23.206929 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.206895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-service-ca\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.207109 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.206940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d5l6\" (UniqueName: \"kubernetes.io/projected/7899c379-fb63-4c36-a228-cccff1d40835-kube-api-access-2d5l6\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.207109 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.206960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7899c379-fb63-4c36-a228-cccff1d40835-console-oauth-config\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.207109 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.207021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-trusted-ca-bundle\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.207109 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.207096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7899c379-fb63-4c36-a228-cccff1d40835-console-serving-cert\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.207295 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.207164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-console-config\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.207295 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.207190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-oauth-serving-cert\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.308475 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.308381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-console-config\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.308475 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.308429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-oauth-serving-cert\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.308725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.308478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-service-ca\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.308725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.308529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5l6\" (UniqueName: \"kubernetes.io/projected/7899c379-fb63-4c36-a228-cccff1d40835-kube-api-access-2d5l6\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.308725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.308574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7899c379-fb63-4c36-a228-cccff1d40835-console-oauth-config\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.308725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.308593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-trusted-ca-bundle\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.308725 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.308614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7899c379-fb63-4c36-a228-cccff1d40835-console-serving-cert\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.309304 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.309277 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-oauth-serving-cert\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.309471 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.309369 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-console-config\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.309597 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.309521 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-trusted-ca-bundle\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.309751 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.309734 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7899c379-fb63-4c36-a228-cccff1d40835-service-ca\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.311089 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.311068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7899c379-fb63-4c36-a228-cccff1d40835-console-oauth-config\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.311188 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.311172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7899c379-fb63-4c36-a228-cccff1d40835-console-serving-cert\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.326498 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.326477 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d5l6\" (UniqueName: \"kubernetes.io/projected/7899c379-fb63-4c36-a228-cccff1d40835-kube-api-access-2d5l6\") pod \"console-85b688749b-72kvk\" (UID: \"7899c379-fb63-4c36-a228-cccff1d40835\") " pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.369479 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.369461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:23.504035 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:23.503987 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b688749b-72kvk"] Jul 31 09:37:23.506207 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:37:23.506179 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7899c379_fb63_4c36_a228_cccff1d40835.slice/crio-577f7d6ac33d2d195619f2d08b05778a6a3c87051a8783ca6abd735fb62a7e01 WatchSource:0}: Error finding container 577f7d6ac33d2d195619f2d08b05778a6a3c87051a8783ca6abd735fb62a7e01: Status 404 returned error can't find the container with id 577f7d6ac33d2d195619f2d08b05778a6a3c87051a8783ca6abd735fb62a7e01 Jul 31 09:37:24.006086 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:24.006047 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b688749b-72kvk" event={"ID":"7899c379-fb63-4c36-a228-cccff1d40835","Type":"ContainerStarted","Data":"b2ce6b344bb0e17dc8802250109c1a6dbfb918ae3404e918d802b64608534a2b"} Jul 31 09:37:24.006276 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:24.006098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b688749b-72kvk" event={"ID":"7899c379-fb63-4c36-a228-cccff1d40835","Type":"ContainerStarted","Data":"577f7d6ac33d2d195619f2d08b05778a6a3c87051a8783ca6abd735fb62a7e01"} Jul 31 09:37:24.025845 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:24.025800 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85b688749b-72kvk" podStartSLOduration=1.025784955 podStartE2EDuration="1.025784955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:37:24.025356257 +0000 UTC m=+395.431886388" watchObservedRunningTime="2026-07-31 09:37:24.025784955 +0000 UTC m=+395.432315132" Jul 31 09:37:33.369732 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:33.369694 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:33.370100 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:33.369966 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:33.374714 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:33.374690 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:34.052858 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:34.052828 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85b688749b-72kvk" Jul 31 09:37:34.104600 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:34.104569 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7777644fdb-hx6q4"] Jul 31 09:37:35.461415 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.461378 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4"] Jul 31 09:37:35.464841 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.464821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.467452 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.467433 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 31 09:37:35.468444 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.468427 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-dpsrc\"" Jul 31 09:37:35.468531 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.468455 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 31 09:37:35.477984 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.477959 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4"] Jul 31 09:37:35.511344 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.511311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2417b6b3-6076-4e4d-854a-1db293830210-tmp\") pod \"trainer-operator-controller-manager-b9b9cc77f-h4bw4\" (UID: \"2417b6b3-6076-4e4d-854a-1db293830210\") " pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.511488 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.511377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/2417b6b3-6076-4e4d-854a-1db293830210-manifests-work\") pod \"trainer-operator-controller-manager-b9b9cc77f-h4bw4\" (UID: \"2417b6b3-6076-4e4d-854a-1db293830210\") " pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.511488 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.511420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hwld\" (UniqueName: \"kubernetes.io/projected/2417b6b3-6076-4e4d-854a-1db293830210-kube-api-access-7hwld\") pod \"trainer-operator-controller-manager-b9b9cc77f-h4bw4\" (UID: \"2417b6b3-6076-4e4d-854a-1db293830210\") " pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.612246 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.612211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hwld\" (UniqueName: \"kubernetes.io/projected/2417b6b3-6076-4e4d-854a-1db293830210-kube-api-access-7hwld\") pod \"trainer-operator-controller-manager-b9b9cc77f-h4bw4\" (UID: \"2417b6b3-6076-4e4d-854a-1db293830210\") " pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.612410 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.612271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2417b6b3-6076-4e4d-854a-1db293830210-tmp\") pod \"trainer-operator-controller-manager-b9b9cc77f-h4bw4\" (UID: \"2417b6b3-6076-4e4d-854a-1db293830210\") " pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.612410 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.612313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/2417b6b3-6076-4e4d-854a-1db293830210-manifests-work\") pod \"trainer-operator-controller-manager-b9b9cc77f-h4bw4\" (UID: \"2417b6b3-6076-4e4d-854a-1db293830210\") " pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.612699 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.612684 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/2417b6b3-6076-4e4d-854a-1db293830210-manifests-work\") pod \"trainer-operator-controller-manager-b9b9cc77f-h4bw4\" (UID: \"2417b6b3-6076-4e4d-854a-1db293830210\") " pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.612783 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.612763 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2417b6b3-6076-4e4d-854a-1db293830210-tmp\") pod \"trainer-operator-controller-manager-b9b9cc77f-h4bw4\" (UID: \"2417b6b3-6076-4e4d-854a-1db293830210\") " pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.622258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.622236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hwld\" (UniqueName: \"kubernetes.io/projected/2417b6b3-6076-4e4d-854a-1db293830210-kube-api-access-7hwld\") pod \"trainer-operator-controller-manager-b9b9cc77f-h4bw4\" (UID: \"2417b6b3-6076-4e4d-854a-1db293830210\") " pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.776028 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.775946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:35.901713 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.901684 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4"] Jul 31 09:37:35.904108 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:37:35.904073 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2417b6b3_6076_4e4d_854a_1db293830210.slice/crio-8365d968aa91becd9d9565048ae147b1540fb537b484426bb68eefe77945eddd WatchSource:0}: Error finding container 8365d968aa91becd9d9565048ae147b1540fb537b484426bb68eefe77945eddd: Status 404 returned error can't find the container with id 8365d968aa91becd9d9565048ae147b1540fb537b484426bb68eefe77945eddd Jul 31 09:37:35.906036 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:35.906019 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 09:37:36.058820 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:36.058734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" event={"ID":"2417b6b3-6076-4e4d-854a-1db293830210","Type":"ContainerStarted","Data":"8365d968aa91becd9d9565048ae147b1540fb537b484426bb68eefe77945eddd"} Jul 31 09:37:39.076709 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:39.076672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" event={"ID":"2417b6b3-6076-4e4d-854a-1db293830210","Type":"ContainerStarted","Data":"d0767d5cc58f39fba68fbdff2bae94c70b6434bb0e08caf9820bc9231859119a"} Jul 31 09:37:39.077089 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:39.076802 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:39.099061 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:39.099007 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" podStartSLOduration=1.845086487 podStartE2EDuration="4.098992045s" totalImagesPullingTime="2.253905558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 09:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:37:39.09749854 +0000 UTC m=+410.504028668" watchObservedRunningTime="2026-07-31 09:37:39.098992045 +0000 UTC m=+410.505522223" Jul 31 09:37:50.084264 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:50.084227 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-b9b9cc77f-h4bw4" Jul 31 09:37:59.125536 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.125484 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7777644fdb-hx6q4" podUID="0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" containerName="console" containerID="cri-o://b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc" gracePeriod=15 Jul 31 09:37:59.366834 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.366806 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:37:59.422820 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.422754 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-serving-cert\") pod \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " Jul 31 09:37:59.422820 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.422802 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-trusted-ca-bundle\") pod \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " Jul 31 09:37:59.423013 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.422832 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-service-ca\") pod \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " Jul 31 09:37:59.423013 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.422936 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-config\") pod \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " Jul 31 09:37:59.423013 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.422977 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssztj\" (UniqueName: \"kubernetes.io/projected/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-kube-api-access-ssztj\") pod \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " Jul 31 09:37:59.423174 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.423024 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-oauth-serving-cert\") pod \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " Jul 31 09:37:59.423174 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.423077 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-oauth-config\") pod \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\" (UID: \"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca\") " Jul 31 09:37:59.423275 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.423171 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-service-ca" (OuterVolumeSpecName: "service-ca") pod "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" (UID: "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:37:59.423327 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.423283 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" (UID: "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:37:59.423327 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.423308 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-config" (OuterVolumeSpecName: "console-config") pod "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" (UID: "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:37:59.423426 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.423394 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-trusted-ca-bundle\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:37:59.423426 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.423413 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:37:59.423426 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.423408 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" (UID: "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 09:37:59.423532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.423427 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-config\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:37:59.424832 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.424808 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" (UID: "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:37:59.425008 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.424994 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-kube-api-access-ssztj" (OuterVolumeSpecName: "kube-api-access-ssztj") pod "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" (UID: "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca"). InnerVolumeSpecName "kube-api-access-ssztj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 09:37:59.425104 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.425090 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" (UID: "0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 09:37:59.523881 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.523847 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssztj\" (UniqueName: \"kubernetes.io/projected/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-kube-api-access-ssztj\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:37:59.523881 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.523874 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-oauth-serving-cert\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:37:59.523881 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.523884 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-oauth-config\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:37:59.524113 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:37:59.523900 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca-console-serving-cert\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\"" Jul 31 09:38:00.185529 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:00.185483 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" containerID="b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc" exitCode=0 Jul 31 09:38:00.185974 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:00.185561 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7777644fdb-hx6q4" Jul 31 09:38:00.185974 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:00.185568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7777644fdb-hx6q4" event={"ID":"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca","Type":"ContainerDied","Data":"b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc"} Jul 31 09:38:00.185974 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:00.185668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7777644fdb-hx6q4" event={"ID":"0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca","Type":"ContainerDied","Data":"7669b33f20c34a3a4e88c3968ba92ecc3f4c98ed1b741d5b716aa7ad57106487"} Jul 31 09:38:00.185974 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:00.185702 2578 scope.go:117] "RemoveContainer" containerID="b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc" Jul 31 09:38:00.195651 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:00.195629 2578 scope.go:117] "RemoveContainer" containerID="b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc" Jul 31 09:38:00.195902 ip-10-0-141-129 kubenswrapper[2578]: E0731 09:38:00.195879 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc\": container with ID starting with b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc not found: ID does not exist" containerID="b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc" Jul 31 09:38:00.195952 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:00.195908 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc"} err="failed to get container status \"b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc\": rpc error: code = NotFound desc = could not find container \"b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc\": container with ID starting with b1085afb115fdef63df97d925f3e35e862ca7b3310085aea28f63306868031dc not found: ID does not exist" Jul 31 09:38:00.207978 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:00.207956 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7777644fdb-hx6q4"] Jul 31 09:38:00.219611 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:00.219590 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7777644fdb-hx6q4"] Jul 31 09:38:01.090594 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:01.090535 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" path="/var/lib/kubelet/pods/0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca/volumes" Jul 31 09:38:50.876889 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:50.876841 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9f5rs_11f6c97c-7d6f-4745-9d75-4a3577df3081/global-pull-secret-syncer/0.log" Jul 31 09:38:50.955532 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:50.955503 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mfrps_c9348038-f3b2-4684-a64a-147c84fc36d7/konnectivity-agent/0.log" Jul 31 09:38:51.078809 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:51.078774 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-129.ec2.internal_972297024dddeb976ba6e91301bc1a0d/haproxy/0.log" Jul 31 09:38:54.768335 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:54.768290 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4/alertmanager/0.log" Jul 31 09:38:54.853839 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:54.853814 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4/config-reloader/0.log" Jul 31 09:38:54.888054 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:54.888016 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4/kube-rbac-proxy-web/0.log" Jul 31 09:38:54.934490 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:54.934466 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4/kube-rbac-proxy/0.log" Jul 31 09:38:55.001612 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.001585 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4/kube-rbac-proxy-metric/0.log" Jul 31 09:38:55.049893 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.049828 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4/prom-label-proxy/0.log" Jul 31 09:38:55.087894 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.087858 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ac68fb8e-52ad-43d4-9c26-86d49ed1f6a4/init-config-reloader/0.log" Jul 31 09:38:55.168845 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.168818 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-85qsb_1aa38323-5532-4744-bc15-cc17dc17845f/kube-state-metrics/0.log" Jul 31 09:38:55.204810 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.204784 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-85qsb_1aa38323-5532-4744-bc15-cc17dc17845f/kube-rbac-proxy-main/0.log" Jul 31 09:38:55.244699 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.244678 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-85qsb_1aa38323-5532-4744-bc15-cc17dc17845f/kube-rbac-proxy-self/0.log" Jul 31 09:38:55.292651 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.292628 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6884fb7b98-cksbx_f06bc4e9-cd18-4b4e-a593-98688c88b925/metrics-server/0.log" Jul 31 09:38:55.565732 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.565702 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mwqvf_8bc7f171-591b-47a8-99a5-ed54dd3c4fd4/node-exporter/0.log" Jul 31 09:38:55.590564 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.590521 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mwqvf_8bc7f171-591b-47a8-99a5-ed54dd3c4fd4/kube-rbac-proxy/0.log" Jul 31 09:38:55.620437 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:55.620413 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mwqvf_8bc7f171-591b-47a8-99a5-ed54dd3c4fd4/init-textfile/0.log" Jul 31 09:38:56.038606 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.038578 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-6qp98_a84378e0-7397-47b4-9479-3c56b2e54386/prometheus-operator/0.log" Jul 31 09:38:56.070988 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.070959 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-6qp98_a84378e0-7397-47b4-9479-3c56b2e54386/kube-rbac-proxy/0.log" Jul 31 09:38:56.116276 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.116257 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-srd22_03c51db6-d1a6-44a0-a0d1-dbb6a9c98d73/prometheus-operator-admission-webhook/0.log" Jul 31 09:38:56.160055 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.160027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b56858bfc-xfbc7_d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc/telemeter-client/0.log" Jul 31 09:38:56.198811 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.198782 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b56858bfc-xfbc7_d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc/reload/0.log" Jul 31 09:38:56.228475 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.228450 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b56858bfc-xfbc7_d6b5231f-0ba7-4b7b-8df6-29d2d4e0bfdc/kube-rbac-proxy/0.log" Jul 31 09:38:56.268801 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.268776 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566cc79cdc-thmpp_b3aed2f4-ef44-4302-a15d-d57e4a4dea06/thanos-query/0.log" Jul 31 09:38:56.294990 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.294917 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566cc79cdc-thmpp_b3aed2f4-ef44-4302-a15d-d57e4a4dea06/kube-rbac-proxy-web/0.log" Jul 31 09:38:56.324444 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.324412 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566cc79cdc-thmpp_b3aed2f4-ef44-4302-a15d-d57e4a4dea06/kube-rbac-proxy/0.log" Jul 31 09:38:56.352087 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.352058 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566cc79cdc-thmpp_b3aed2f4-ef44-4302-a15d-d57e4a4dea06/prom-label-proxy/0.log" Jul 31 09:38:56.386366 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.386343 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566cc79cdc-thmpp_b3aed2f4-ef44-4302-a15d-d57e4a4dea06/kube-rbac-proxy-rules/0.log" Jul 31 09:38:56.417092 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:56.417066 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566cc79cdc-thmpp_b3aed2f4-ef44-4302-a15d-d57e4a4dea06/kube-rbac-proxy-metrics/0.log" Jul 31 09:38:58.161528 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.161494 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp"] Jul 31 09:38:58.161915 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.161864 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" containerName="console" Jul 31 09:38:58.161915 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.161876 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" containerName="console" Jul 31 09:38:58.161988 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.161927 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d23ffcd-35fc-4301-a0a6-6de4fa1fd6ca" containerName="console" Jul 31 09:38:58.166503 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.166481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.169248 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.169225 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8vczp\"/\"openshift-service-ca.crt\"" Jul 31 09:38:58.170337 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.170323 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8vczp\"/\"default-dockercfg-4f6sd\"" Jul 31 09:38:58.170425 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.170365 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8vczp\"/\"kube-root-ca.crt\"" Jul 31 09:38:58.174265 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.174241 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp"] Jul 31 09:38:58.315868 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.315833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-sys\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.316069 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.315915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-proc\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.316069 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.315965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-lib-modules\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.316069 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.315995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-podres\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.316069 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.316033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9bh9\" (UniqueName: \"kubernetes.io/projected/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-kube-api-access-c9bh9\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.411391 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.411362 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85b688749b-72kvk_7899c379-fb63-4c36-a228-cccff1d40835/console/0.log" Jul 31 09:38:58.417053 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.417004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-proc\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.417053 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.417042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-lib-modules\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.417258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.417056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-podres\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.417258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.417082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9bh9\" (UniqueName: \"kubernetes.io/projected/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-kube-api-access-c9bh9\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.417258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.417126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-sys\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.417258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.417134 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-proc\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.417258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.417170 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-lib-modules\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.417258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.417172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-podres\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.417258 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.417217 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-sys\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.425801 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.425775 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9bh9\" (UniqueName: \"kubernetes.io/projected/bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0-kube-api-access-c9bh9\") pod \"perf-node-gather-daemonset-bzhwp\" (UID: \"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0\") " pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.439206 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.439188 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-6xj9l_1b2ee657-db62-49ae-a679-c8973ac76cec/download-server/0.log" Jul 31 09:38:58.481778 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.481758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:58.611900 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:58.611861 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp"] Jul 31 09:38:58.615731 ip-10-0-141-129 kubenswrapper[2578]: W0731 09:38:58.615699 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd13c0fe_8fbd_4a49_8876_bc14dcb15ca0.slice/crio-63b4f5eeec62200ad066d1951b55ef948d5874bf1ca628110c11500a88cd9484 WatchSource:0}: Error finding container 63b4f5eeec62200ad066d1951b55ef948d5874bf1ca628110c11500a88cd9484: Status 404 returned error can't find the container with id 63b4f5eeec62200ad066d1951b55ef948d5874bf1ca628110c11500a88cd9484 Jul 31 09:38:59.012978 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:59.012883 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-82f2h_65579c9a-757e-4c90-be4c-cb3abecaca61/volume-data-source-validator/0.log" Jul 31 09:38:59.457248 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:59.457213 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" event={"ID":"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0","Type":"ContainerStarted","Data":"1c6bbd471c95d752c66fd6be95ba62076f528748d574eef67a00a2747bd4c696"} Jul 31 09:38:59.457717 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:59.457265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" event={"ID":"bd13c0fe-8fbd-4a49-8876-bc14dcb15ca0","Type":"ContainerStarted","Data":"63b4f5eeec62200ad066d1951b55ef948d5874bf1ca628110c11500a88cd9484"} Jul 31 09:38:59.457717 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:59.457299 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:38:59.475689 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:38:59.475645 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" podStartSLOduration=1.475630093 podStartE2EDuration="1.475630093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 09:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 09:38:59.474667825 +0000 UTC m=+490.881197957" watchObservedRunningTime="2026-07-31 09:38:59.475630093 +0000 UTC m=+490.882160222" Jul 31 09:39:00.008439 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:00.008408 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwtww_c8e861e1-de09-4478-b1cb-d4f2ff552c80/dns/0.log" Jul 31 09:39:00.031905 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:00.031872 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwtww_c8e861e1-de09-4478-b1cb-d4f2ff552c80/kube-rbac-proxy/0.log" Jul 31 09:39:00.131513 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:00.131485 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q2pvs_3c86319d-26ad-4dc0-938c-2fc9e87a8945/dns-node-resolver/0.log" Jul 31 09:39:00.672177 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:00.672151 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2fjx_545bfd62-358c-4743-80df-242a578ecf2f/node-ca/0.log" Jul 31 09:39:01.897913 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:01.897881 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nlqnw_c958ada3-666d-4ff7-be9c-a827dbcdb66c/serve-healthcheck-canary/0.log" Jul 31 09:39:02.532115 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:02.532088 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ztxsb_54698be4-bc69-4fda-a403-1d04e0dd0a7c/kube-rbac-proxy/0.log" Jul 31 09:39:02.558969 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:02.558943 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ztxsb_54698be4-bc69-4fda-a403-1d04e0dd0a7c/exporter/0.log" Jul 31 09:39:02.584770 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:02.584747 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ztxsb_54698be4-bc69-4fda-a403-1d04e0dd0a7c/extractor/0.log" Jul 31 09:39:04.305699 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:04.305672 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-58c84b5978-rhm49_6bed603e-c59d-49b1-b773-1806e120bb07/manager/0.log" Jul 31 09:39:05.470770 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:05.470745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8vczp/perf-node-gather-daemonset-bzhwp" Jul 31 09:39:09.655254 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:09.655224 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mnxct_7044dae5-8825-4d90-aab4-30b47b5600e2/kube-multus-additional-cni-plugins/0.log" Jul 31 09:39:09.677968 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:09.677946 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mnxct_7044dae5-8825-4d90-aab4-30b47b5600e2/egress-router-binary-copy/0.log" Jul 31 09:39:09.700240 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:09.700224 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mnxct_7044dae5-8825-4d90-aab4-30b47b5600e2/cni-plugins/0.log" Jul 31 09:39:09.722931 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:09.722914 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mnxct_7044dae5-8825-4d90-aab4-30b47b5600e2/bond-cni-plugin/0.log" Jul 31 09:39:09.746195 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:09.746176 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mnxct_7044dae5-8825-4d90-aab4-30b47b5600e2/routeoverride-cni/0.log" Jul 31 09:39:09.770033 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:09.770015 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mnxct_7044dae5-8825-4d90-aab4-30b47b5600e2/whereabouts-cni-bincopy/0.log" Jul 31 09:39:09.801310 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:09.801291 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mnxct_7044dae5-8825-4d90-aab4-30b47b5600e2/whereabouts-cni/0.log" Jul 31 09:39:10.313940 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:10.313914 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mcx7k_3b283adb-9daf-493b-82da-5fb2e92ff59b/kube-multus/0.log" Jul 31 09:39:10.446367 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:10.446337 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9cbhc_d83740ca-ebfe-45da-bee7-220b954c33d3/network-metrics-daemon/0.log" Jul 31 09:39:10.488299 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:10.488274 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9cbhc_d83740ca-ebfe-45da-bee7-220b954c33d3/kube-rbac-proxy/0.log" Jul 31 09:39:11.589813 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:11.589762 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76zkr_7e00adee-1923-4395-b52a-dc1e1b6ea5e2/ovn-controller/0.log" Jul 31 09:39:11.618477 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:11.618456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76zkr_7e00adee-1923-4395-b52a-dc1e1b6ea5e2/ovn-acl-logging/0.log" Jul 31 09:39:11.647403 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:11.647378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76zkr_7e00adee-1923-4395-b52a-dc1e1b6ea5e2/kube-rbac-proxy-node/0.log" Jul 31 09:39:11.677426 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:11.677403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76zkr_7e00adee-1923-4395-b52a-dc1e1b6ea5e2/kube-rbac-proxy-ovn-metrics/0.log" Jul 31 09:39:11.705396 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:11.705357 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76zkr_7e00adee-1923-4395-b52a-dc1e1b6ea5e2/northd/0.log" Jul 31 09:39:11.731337 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:11.731313 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76zkr_7e00adee-1923-4395-b52a-dc1e1b6ea5e2/nbdb/0.log" Jul 31 09:39:11.755162 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:11.755129 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76zkr_7e00adee-1923-4395-b52a-dc1e1b6ea5e2/sbdb/0.log" Jul 31 09:39:11.794887 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:11.794868 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76zkr_7e00adee-1923-4395-b52a-dc1e1b6ea5e2/ovnkube-controller/0.log" Jul 31 09:39:13.206247 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:13.206214 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-z65mq_15756e9c-2f7b-453a-995f-e13c9bd0be46/network-check-target-container/0.log" Jul 31 09:39:14.196954 ip-10-0-141-129 kubenswrapper[2578]: I0731 09:39:14.196877 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8w8mm_c5326e31-5f50-437e-9a58-c99c0be38f46/iptables-alerter/0.log"