Jul 16 21:48:08.142900 ip-10-0-139-247 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 21:48:08.142915 ip-10-0-139-247 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 21:48:08.142925 ip-10-0-139-247 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 21:48:08.143267 ip-10-0-139-247 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 21:48:18.339652 ip-10-0-139-247 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 21:48:18.339671 ip-10-0-139-247 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 70527a2c4de7453eab70147925c4b651 -- Jul 16 21:50:11.587988 ip-10-0-139-247 systemd[1]: Starting Kubernetes Kubelet... Jul 16 21:50:11.970112 ip-10-0-139-247 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 21:50:11.970112 ip-10-0-139-247 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 21:50:11.970112 ip-10-0-139-247 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 21:50:11.970112 ip-10-0-139-247 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 21:50:11.970112 ip-10-0-139-247 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 21:50:11.972487 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.972359 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 21:50:11.978312 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978293 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:50:11.978312 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978311 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:50:11.978312 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978315 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978318 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978322 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978325 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978328 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978330 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978333 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978336 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978338 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978341 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978343 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978346 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978351 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978355 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978358 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978361 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978364 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978371 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978374 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:50:11.978402 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978377 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978380 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978383 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978386 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978389 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978391 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978394 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978396 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978399 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978402 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978405 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978408 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978410 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978413 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978415 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978418 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978421 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978423 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978425 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978427 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:50:11.978846 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978430 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978432 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978435 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978438 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978441 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978443 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978446 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978448 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978450 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978453 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978455 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978458 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978460 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978463 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978467 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978471 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978474 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978477 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978480 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:50:11.979308 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978483 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978487 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978490 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978493 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978496 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978498 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978500 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978503 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978505 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978508 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978511 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978513 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978517 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978519 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978522 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978525 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978527 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978529 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978532 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978534 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:50:11.979978 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978536 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978539 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978542 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978544 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978547 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978550 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978552 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978556 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978559 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978562 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978564 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978567 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978569 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978571 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978574 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978576 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978579 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978581 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.978583 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979381 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:50:11.980657 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979395 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979399 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979402 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979405 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979408 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979411 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979414 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979417 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979419 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979422 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979424 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979428 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979432 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979435 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979438 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979441 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979443 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979445 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979448 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:50:11.981445 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979452 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979457 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979460 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979463 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979466 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979469 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979471 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979474 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979477 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979486 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979489 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979491 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979494 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979497 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979500 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979503 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979506 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979509 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979511 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979513 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:50:11.982251 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979516 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979518 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979521 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979523 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979526 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979528 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979531 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979533 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979536 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979538 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979541 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979543 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979546 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979548 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979551 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979553 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979557 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979560 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979563 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:50:11.983088 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979566 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979569 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979571 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.979628 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980561 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980598 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980606 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980612 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980641 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980836 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980850 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980856 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980860 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980865 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980869 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980873 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980878 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980882 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980886 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980890 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:50:11.983795 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980894 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980898 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980902 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980907 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980911 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980915 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980919 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980923 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980927 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980931 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980936 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980939 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980944 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980948 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980953 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980957 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980961 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980965 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980970 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.980975 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:50:11.984281 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981580 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981589 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981594 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981599 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981603 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981607 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981611 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981616 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981620 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981624 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981628 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981632 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981636 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981640 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981644 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981648 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981653 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981657 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981661 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981665 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:50:11.984866 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981669 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981674 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981678 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981682 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981687 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981692 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981696 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981700 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981704 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981727 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981731 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981735 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981739 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981744 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981748 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981752 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981757 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981761 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981765 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981769 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:50:11.985502 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981773 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981777 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981781 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981785 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981789 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981793 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981797 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981801 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981805 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981811 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981815 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981820 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981824 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981828 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981832 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981836 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981840 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981846 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981852 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:50:11.986128 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981858 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981863 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981869 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981875 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981880 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981884 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981889 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981895 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981899 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981904 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981910 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981914 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981919 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981923 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981928 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981932 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981936 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981942 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981947 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:50:11.986594 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981953 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981958 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981963 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981967 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981972 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981976 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981980 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981984 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981988 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981992 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.981997 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982001 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982005 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982009 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982013 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982017 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982021 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982025 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982029 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982033 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:50:11.987137 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.982038 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982133 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982144 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982154 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982161 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982167 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982172 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982179 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982185 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982190 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982195 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982201 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982206 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982210 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982215 2580 flags.go:64] FLAG: --cgroup-root="" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982220 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982225 2580 flags.go:64] FLAG: --client-ca-file="" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982230 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982235 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982241 2580 flags.go:64] FLAG: --cluster-domain="" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982245 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982250 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982255 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982260 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 21:50:11.987639 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982266 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982271 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982275 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982280 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982285 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982290 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982295 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982300 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982304 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982311 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982315 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982320 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982324 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982329 2580 flags.go:64] FLAG: --enable-server="true" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982333 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982341 2580 flags.go:64] FLAG: --event-burst="100" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982345 2580 flags.go:64] FLAG: --event-qps="50" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982350 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982355 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982359 2580 flags.go:64] FLAG: --eviction-hard="" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982365 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982377 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982382 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982387 2580 flags.go:64] FLAG: --eviction-soft="" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982391 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 21:50:11.988303 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982396 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982401 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982406 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982410 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982414 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982419 2580 flags.go:64] FLAG: --feature-gates="" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982424 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982429 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982434 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982439 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982444 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982449 2580 flags.go:64] FLAG: --help="false" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982453 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-139-247.ec2.internal" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982458 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982463 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982467 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982472 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982478 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982482 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982487 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982508 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982513 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982517 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982522 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 21:50:11.988930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982527 2580 flags.go:64] FLAG: --kube-reserved="" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982532 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982536 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982541 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982547 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982552 2580 flags.go:64] FLAG: --lock-file="" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982557 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982562 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982567 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982581 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982586 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982590 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982595 2580 flags.go:64] FLAG: --logging-format="text" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982599 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982604 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982609 2580 flags.go:64] FLAG: --manifest-url="" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982613 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982619 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982624 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982631 2580 flags.go:64] FLAG: --max-pods="110" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982636 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982640 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982645 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982650 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982654 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 21:50:11.989492 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982659 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982663 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982674 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982679 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982683 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982688 2580 flags.go:64] FLAG: --pod-cidr="" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982692 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982701 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982705 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982728 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982733 2580 flags.go:64] FLAG: --port="10250" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982740 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982745 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ac119d81ed46de6a" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982750 2580 flags.go:64] FLAG: --qos-reserved="" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982756 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982761 2580 flags.go:64] FLAG: --register-node="true" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982766 2580 flags.go:64] FLAG: --register-with-taints="" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982771 2580 flags.go:64] FLAG: --registry-burst="10" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982776 2580 flags.go:64] FLAG: --registry-qps="5" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982780 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982785 2580 flags.go:64] FLAG: --reserved-memory="" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982790 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982795 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982800 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982804 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 21:50:11.990152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982809 2580 flags.go:64] FLAG: --runonce="false" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982813 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982818 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982823 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982827 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982833 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982839 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982843 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982848 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982852 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982857 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982861 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982866 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982871 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982875 2580 flags.go:64] FLAG: --system-cgroups="" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982880 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982888 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982893 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982899 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982906 2580 flags.go:64] FLAG: --tls-min-version="" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982910 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982914 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982921 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982925 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982930 2580 flags.go:64] FLAG: --v="2" Jul 16 21:50:11.990790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982936 2580 flags.go:64] FLAG: --version="false" Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982943 2580 flags.go:64] FLAG: --vmodule="" Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982948 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.982954 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983150 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983158 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983163 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983168 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983174 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983178 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983183 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983187 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983195 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983200 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983204 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983208 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983213 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983217 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983221 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983225 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:50:11.991411 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983229 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983233 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983237 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983241 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983245 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983251 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983255 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983260 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983264 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983268 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983273 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983277 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983281 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983285 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983290 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983294 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983298 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983302 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983307 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983310 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:50:11.991895 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983317 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983323 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983328 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983333 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983339 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983344 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983350 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983355 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983362 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983367 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983372 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983377 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983381 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983387 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983391 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983395 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983399 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983406 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983410 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:50:11.992367 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983414 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983419 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983423 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983427 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983431 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983436 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983440 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983444 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983448 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983453 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983457 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983461 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983465 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983469 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983473 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983477 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983481 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983486 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983491 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983495 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:50:11.992887 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983499 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983503 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983507 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983511 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983514 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983518 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983523 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983527 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983531 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983535 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983540 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983545 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983548 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983553 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983557 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983561 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983565 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983570 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983574 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:50:11.993340 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983578 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983582 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983586 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983590 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.983594 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.984281 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.992610 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.992630 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.992653 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.992659 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992739 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992745 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992748 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992751 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992754 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:50:11.993810 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992757 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992760 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992763 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992765 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992768 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992772 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992777 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992780 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992783 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992785 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992788 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992791 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992793 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992796 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992798 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992801 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992803 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992806 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992808 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992811 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:50:11.994165 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992813 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992816 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992819 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992821 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992826 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992828 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992831 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992834 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992836 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992839 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992841 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992843 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992846 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992848 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992851 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992853 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992856 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992858 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992861 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992863 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:50:11.994620 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992866 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992868 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992871 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992873 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992875 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992878 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992881 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992883 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992885 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992888 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992890 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992893 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992895 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992898 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992902 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992904 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992907 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992910 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992913 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992915 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:50:11.995097 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992918 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992920 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992922 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992925 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992927 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992929 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992932 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992934 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992937 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992939 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992942 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992944 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992947 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992949 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992953 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992957 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992959 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992962 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992964 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:50:11.995557 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992967 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992969 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992972 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992975 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992977 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992979 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992982 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992984 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992987 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992990 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992993 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.992997 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993000 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993003 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:50:11.996007 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993006 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.993011 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993181 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993185 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993188 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993191 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993194 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993197 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993200 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993203 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993206 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993208 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993211 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993213 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993216 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:50:11.996332 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993218 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993221 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993224 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993226 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993229 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993231 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993234 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993236 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993239 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993243 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993246 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993249 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993252 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993255 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993257 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993261 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993263 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993266 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993269 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:50:11.996689 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993271 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993274 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993276 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993279 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993281 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993283 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993286 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993289 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993291 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993293 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993296 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993298 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993300 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993303 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993306 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993308 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993311 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993313 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993316 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:50:11.997160 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993318 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993321 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993324 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993326 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993328 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993331 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993334 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993336 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993340 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993343 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993346 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993349 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993352 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993355 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993358 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993360 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993363 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993365 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993368 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:50:11.997595 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993370 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993373 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993375 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993377 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993380 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993383 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993386 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993389 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993391 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993394 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993396 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993398 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993401 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993403 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993406 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993411 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993413 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993416 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993418 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:50:11.998162 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993421 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993423 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993426 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993428 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993431 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993434 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993437 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993439 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993442 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:11.993444 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.993449 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.993573 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.996004 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.997414 2580 server.go:1019] "Starting client certificate rotation" Jul 16 21:50:11.998592 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.997519 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 21:50:11.998938 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.997555 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 21:50:11.999687 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:11.999674 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 21:50:12.003569 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.003555 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 21:50:12.015370 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.015348 2580 log.go:25] "Validated CRI v1 runtime API" Jul 16 21:50:12.017766 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.017749 2580 log.go:25] "Validated CRI v1 image API" Jul 16 21:50:12.018625 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.018610 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 21:50:12.023047 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.023023 2580 fs.go:135] Filesystem UUIDs: map[6e299237-cc4b-466b-9a4f-bc074a0235e9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7b628489-be52-4925-bbff-fa0e5918635d:/dev/nvme0n1p4] Jul 16 21:50:12.023117 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.023045 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 21:50:12.028154 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.028135 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 21:50:12.028321 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.028206 2580 manager.go:216] Machine: {Timestamp:2026-07-16 21:50:12.027000973 +0000 UTC m=+0.328369268 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3190693 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ec632816d9f96c2390dcca969b8cb SystemUUID:ec2ec632-816d-9f96-c239-0dcca969b8cb BootID:70527a2c-4de7-453e-ab70-147925c4b651 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:cd:6e:e3:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:cd:6e:e3:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:b5:cb:1b:b2:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 21:50:12.028321 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.028319 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 21:50:12.028421 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.028408 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 21:50:12.031936 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.031909 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 21:50:12.032078 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.031940 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-247.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 21:50:12.032672 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.032661 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 21:50:12.032704 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.032674 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 21:50:12.032704 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.032681 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 21:50:12.032704 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.032694 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 21:50:12.034346 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.034335 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 21:50:12.037783 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.037769 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 16 21:50:12.037901 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.037892 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 21:50:12.037928 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.037923 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 16 21:50:12.037954 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.037933 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 21:50:12.037954 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.037943 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 21:50:12.037954 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.037952 2580 kubelet.go:398] "Adding apiserver pod source" Jul 16 21:50:12.038056 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.037961 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 21:50:12.038334 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.038323 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 21:50:12.038380 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.038341 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 21:50:12.041177 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.041156 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 21:50:12.044546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.044530 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 21:50:12.044621 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.044567 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 21:50:12.045973 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.045961 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.045978 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.045984 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.045989 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.045998 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.046003 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.046010 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.046015 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.046022 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.046027 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.046044 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 21:50:12.046053 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.046050 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 21:50:12.046831 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.046822 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 21:50:12.046831 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.046831 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 21:50:12.048358 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.048334 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 21:50:12.048444 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.048385 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 21:50:12.049964 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.049952 2580 server.go:1268] "Started kubelet" Jul 16 21:50:12.050058 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.050025 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 21:50:12.050108 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.050039 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 21:50:12.050161 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.050075 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 21:50:12.050789 ip-10-0-139-247 systemd[1]: Started Kubernetes Kubelet. Jul 16 21:50:12.054998 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.054973 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 21:50:12.055738 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.055689 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 16 21:50:12.056628 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.056604 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xrnb9" Jul 16 21:50:12.056707 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.056670 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 21:50:12.057855 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.057836 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-247.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 21:50:12.058748 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.057793 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-247.ec2.internal.18c2e39079c583c5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-247.ec2.internal,UID:ip-10-0-139-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-247.ec2.internal,},FirstTimestamp:2026-07-16 21:50:12.049920965 +0000 UTC m=+0.351289262,LastTimestamp:2026-07-16 21:50:12.049920965 +0000 UTC m=+0.351289262,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-247.ec2.internal,}" Jul 16 21:50:12.064064 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.064042 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 21:50:12.064064 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.064058 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 21:50:12.064204 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.064141 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.064866 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.064822 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 21:50:12.064866 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.064843 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 21:50:12.064866 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.064867 2580 factory.go:55] Registering systemd factory Jul 16 21:50:12.065044 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.064894 2580 factory.go:223] Registration of the systemd container factory successfully Jul 16 21:50:12.065044 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.064815 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 21:50:12.065044 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.064971 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 16 21:50:12.065044 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.064979 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 16 21:50:12.065218 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.065200 2580 factory.go:153] Registering CRI-O factory Jul 16 21:50:12.065218 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.065217 2580 factory.go:223] Registration of the crio container factory successfully Jul 16 21:50:12.065374 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.065264 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 21:50:12.065374 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.065286 2580 factory.go:103] Registering Raw factory Jul 16 21:50:12.065374 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.065300 2580 manager.go:1196] Started watching for new ooms in manager Jul 16 21:50:12.065917 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.065900 2580 manager.go:349] Starting recovery of all containers Jul 16 21:50:12.066070 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.066051 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xrnb9" Jul 16 21:50:12.074989 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.074971 2580 manager.go:354] Recovery completed Jul 16 21:50:12.075111 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.075025 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:50:12.078510 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.078491 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-247.ec2.internal\" not found" node="ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.079758 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.079745 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:50:12.081669 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.081649 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:50:12.081768 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.081678 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:50:12.081768 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.081689 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:50:12.082205 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.082192 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 21:50:12.082205 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.082202 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:50:12.082285 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.082204 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 21:50:12.082285 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.082243 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 16 21:50:12.082901 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.082887 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:50:12.082974 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.082916 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:50:12.082974 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.082931 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:50:12.083550 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.083538 2580 policy_none.go:49] "None policy: Start" Jul 16 21:50:12.083592 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.083553 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 21:50:12.083592 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.083563 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 21:50:12.084800 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.084787 2580 policy_none.go:47] "Start" Jul 16 21:50:12.128155 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.127981 2580 manager.go:337] "Starting Device Plugin manager" Jul 16 21:50:12.128251 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.128193 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 21:50:12.128251 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.128220 2580 server.go:87] "Starting device plugin registration server" Jul 16 21:50:12.128537 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.128524 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 21:50:12.128575 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.128540 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 21:50:12.128686 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.128672 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 21:50:12.128848 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.128834 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 21:50:12.128942 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.128850 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 21:50:12.129423 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.129400 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 21:50:12.129545 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.129459 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.228133 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.228097 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 21:50:12.230078 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.229292 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 21:50:12.230078 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.229305 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:50:12.230078 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.229324 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 21:50:12.230078 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.229349 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 21:50:12.230078 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.229393 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 21:50:12.230606 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.230571 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:50:12.230700 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.230616 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:50:12.230944 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.230923 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:50:12.231040 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.230999 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.232029 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.231981 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:50:12.237325 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.237309 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.237394 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.237329 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-247.ec2.internal\": node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.292886 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.292855 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.330574 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.329650 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal"] Jul 16 21:50:12.330690 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.330631 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:50:12.331790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.331772 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:50:12.331863 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.331804 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:50:12.331863 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.331814 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:50:12.333613 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.333599 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:50:12.333765 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.333750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.333813 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.333791 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:50:12.334364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.334342 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:50:12.334469 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.334378 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:50:12.334469 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.334392 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:50:12.334469 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.334344 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:50:12.334469 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.334461 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:50:12.334629 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.334476 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:50:12.336190 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.336174 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.336248 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.336202 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:50:12.336914 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.336901 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:50:12.336984 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.336930 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:50:12.336984 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.336945 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:50:12.365631 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.365608 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-247.ec2.internal\" not found" node="ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.366694 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.366669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7940344e37b0417b90f8d2a19bc8556-config\") pod \"kube-apiserver-proxy-ip-10-0-139-247.ec2.internal\" (UID: \"f7940344e37b0417b90f8d2a19bc8556\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.366778 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.366696 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/495397dc6f1a16a9be49692203c6b127-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal\" (UID: \"495397dc6f1a16a9be49692203c6b127\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.366778 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.366721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495397dc6f1a16a9be49692203c6b127-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal\" (UID: \"495397dc6f1a16a9be49692203c6b127\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.369158 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.369140 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-247.ec2.internal\" not found" node="ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.393598 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.393573 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.467885 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.467860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7940344e37b0417b90f8d2a19bc8556-config\") pod \"kube-apiserver-proxy-ip-10-0-139-247.ec2.internal\" (UID: \"f7940344e37b0417b90f8d2a19bc8556\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.467977 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.467889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/495397dc6f1a16a9be49692203c6b127-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal\" (UID: \"495397dc6f1a16a9be49692203c6b127\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.467977 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.467908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495397dc6f1a16a9be49692203c6b127-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal\" (UID: \"495397dc6f1a16a9be49692203c6b127\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.467977 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.467959 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/495397dc6f1a16a9be49692203c6b127-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal\" (UID: \"495397dc6f1a16a9be49692203c6b127\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.468077 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.467968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7940344e37b0417b90f8d2a19bc8556-config\") pod \"kube-apiserver-proxy-ip-10-0-139-247.ec2.internal\" (UID: \"f7940344e37b0417b90f8d2a19bc8556\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.468077 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.468016 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495397dc6f1a16a9be49692203c6b127-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal\" (UID: \"495397dc6f1a16a9be49692203c6b127\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.494068 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.494014 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.594787 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.594756 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.669819 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.669800 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.674245 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.674231 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal" Jul 16 21:50:12.695950 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.695929 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.798040 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.797971 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.900027 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:12.899999 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:12.996917 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.996888 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 21:50:12.997281 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.997040 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 21:50:12.997281 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:12.997079 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 21:50:13.000082 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:13.000064 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:13.060096 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:13.060046 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:50:13.071786 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:13.071761 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 21:45:12 +0000 UTC" deadline="2028-01-03 09:04:48.207095034 +0000 UTC" Jul 16 21:50:13.071786 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:13.071783 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12851h14m35.135314397s" Jul 16 21:50:13.101215 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:13.101199 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:13.201494 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:13.201455 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:13.302725 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:13.302677 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-247.ec2.internal\" not found" Jul 16 21:50:13.378571 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:13.378549 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:50:13.458883 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:13.458840 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495397dc6f1a16a9be49692203c6b127.slice/crio-af233ecfd59d1e7bb98307a41c4454bec1e2b83ce7d7519f27c02ae4616ae947 WatchSource:0}: Error finding container af233ecfd59d1e7bb98307a41c4454bec1e2b83ce7d7519f27c02ae4616ae947: Status 404 returned error can't find the container with id af233ecfd59d1e7bb98307a41c4454bec1e2b83ce7d7519f27c02ae4616ae947 Jul 16 21:50:13.459237 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:13.459214 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7940344e37b0417b90f8d2a19bc8556.slice/crio-aadd3f9b06325ee22740a6c161cf310f4cb916c6127b79fdca72d10a29a6ac9c WatchSource:0}: Error finding container aadd3f9b06325ee22740a6c161cf310f4cb916c6127b79fdca72d10a29a6ac9c: Status 404 returned error can't find the container with id aadd3f9b06325ee22740a6c161cf310f4cb916c6127b79fdca72d10a29a6ac9c Jul 16 21:50:13.463657 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:13.463641 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 21:50:13.464227 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:13.464212 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" Jul 16 21:50:13.482115 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:13.482095 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 21:50:13.483178 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:13.483162 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal" Jul 16 21:50:13.497073 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:13.497050 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 21:50:14.042194 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.042171 2580 apiserver.go:52] "Watching apiserver" Jul 16 21:50:14.051952 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.051933 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 21:50:14.052308 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.052286 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal","openshift-multus/multus-additional-cni-plugins-hqsp4","openshift-multus/multus-t74t6","openshift-multus/network-metrics-daemon-46cth","openshift-network-diagnostics/network-check-target-dqmwr","openshift-network-operator/iptables-alerter-6rsqs","kube-system/konnectivity-agent-8hrxs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw","openshift-cluster-node-tuning-operator/tuned-s44fz","openshift-dns/node-resolver-7rfmd","openshift-image-registry/node-ca-8zcdj","openshift-ovn-kubernetes/ovnkube-node-24qjh","kube-system/global-pull-secret-syncer-5s4f7"] Jul 16 21:50:14.054509 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.054491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.056284 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.056265 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:14.057467 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.057436 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g2c6x\"" Jul 16 21:50:14.057467 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.057458 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.057721 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.057697 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 21:50:14.057922 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.057892 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:50:14.057922 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.057903 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 21:50:14.058906 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.058867 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:14.059478 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.059028 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:14.059478 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.059428 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xzz8h\"" Jul 16 21:50:14.060229 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.059875 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 21:50:14.060229 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.060024 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 21:50:14.060923 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.060653 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 21:50:14.061260 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.061238 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4v8lq\"" Jul 16 21:50:14.061508 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.061491 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 21:50:14.061702 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.061678 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 21:50:14.062277 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.061855 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 21:50:14.062277 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.061927 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:14.062277 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.062058 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:14.063653 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.063637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.064967 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.064948 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.065182 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.065162 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 21:50:14.066432 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.066415 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.066657 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.066630 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 21:50:14.067868 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.067852 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.067959 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.067939 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jsjqp\"" Jul 16 21:50:14.068614 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.068598 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 21:50:14.069183 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.069167 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 21:50:14.069315 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.069301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.070228 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.070209 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 21:50:14.070343 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.070218 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 21:50:14.071029 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.070819 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rrf4x\"" Jul 16 21:50:14.071029 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.070857 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 21:50:14.071029 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.070902 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72hsc\"" Jul 16 21:50:14.071029 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.070923 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7rhgs\"" Jul 16 21:50:14.071277 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.071063 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 21:50:14.071277 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.071105 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:50:14.071277 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.071203 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 21:50:14.071390 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.071286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.072763 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.072746 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.072852 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.072823 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:14.074090 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.074076 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 21:50:14.074160 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.074077 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 21:50:14.074526 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.074511 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 21:50:14.074578 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.074561 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 21:50:14.075011 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.074991 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 21:50:14.076283 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.076254 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 21:50:14.076283 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.076275 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 21:50:14.076441 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.076299 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 21:50:14.076441 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.076277 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 21:50:14.077129 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077111 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s824p\"" Jul 16 21:50:14.077247 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-os-release\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.077313 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-sysctl-conf\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.077313 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077283 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dfk6l\"" Jul 16 21:50:14.077313 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-run-netns\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.077450 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077313 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-var-lib-cni-multus\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.077450 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077339 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-etc-kubernetes\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.077450 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077365 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-system-cni-dir\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.077450 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-sysconfig\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.077450 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c349ae3-b927-4208-8e83-37ae92534976-etc-tuned\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.077674 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-system-cni-dir\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.077674 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077485 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-hostroot\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.077674 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96gvc\" (UniqueName: \"kubernetes.io/projected/7e4b8d92-3a02-482d-bc1f-61e537dd7409-kube-api-access-96gvc\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:14.077674 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-sysctl-d\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.077674 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-run-multus-certs\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.077674 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjt4b\" (UniqueName: \"kubernetes.io/projected/39c905d9-86aa-4365-a416-7512750c564b-kube-api-access-gjt4b\") pod \"iptables-alerter-6rsqs\" (UID: \"39c905d9-86aa-4365-a416-7512750c564b\") " pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.077674 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c349ae3-b927-4208-8e83-37ae92534976-tmp\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.078030 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077765 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b2139b2-a6a2-4bd1-81df-140cb9725bec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.078030 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077795 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-cni-binary-copy\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.078030 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-systemd\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.078030 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-modprobe-d\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.078030 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-cnibin\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.078030 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.077989 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-run-k8s-cni-cncf-io\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.078371 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-daemon-config\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.078371 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078075 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-registration-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.078371 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-device-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.078371 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-sys-fs\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.078371 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2139b2-a6a2-4bd1-81df-140cb9725bec-cni-binary-copy\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.078371 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078361 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc6128de-8fec-4aaf-883b-17d7ce474171-konnectivity-ca\") pod \"konnectivity-agent-8hrxs\" (UID: \"bc6128de-8fec-4aaf-883b-17d7ce474171\") " pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-kubernetes\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-os-release\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-var-lib-cni-bin\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-conf-dir\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078523 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-socket-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-cnibin\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b2139b2-a6a2-4bd1-81df-140cb9725bec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.078664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078644 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k5wl\" (UniqueName: \"kubernetes.io/projected/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-kube-api-access-6k5wl\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078668 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4c2k\" (UniqueName: \"kubernetes.io/projected/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-kube-api-access-g4c2k\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39c905d9-86aa-4365-a416-7512750c564b-iptables-alerter-script\") pod \"iptables-alerter-6rsqs\" (UID: \"39c905d9-86aa-4365-a416-7512750c564b\") " pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39c905d9-86aa-4365-a416-7512750c564b-host-slash\") pod \"iptables-alerter-6rsqs\" (UID: \"39c905d9-86aa-4365-a416-7512750c564b\") " pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-run\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-socket-dir-parent\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-var-lib-kubelet\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-lib-modules\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-var-lib-kubelet\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.078994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-host\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.079020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7nwp\" (UniqueName: \"kubernetes.io/projected/7c349ae3-b927-4208-8e83-37ae92534976-kube-api-access-g7nwp\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.079044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.079091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.079126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.079152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.079152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc6128de-8fec-4aaf-883b-17d7ce474171-agent-certs\") pod \"konnectivity-agent-8hrxs\" (UID: \"bc6128de-8fec-4aaf-883b-17d7ce474171\") " pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:14.079833 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.079176 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6tr\" (UniqueName: \"kubernetes.io/projected/0b2139b2-a6a2-4bd1-81df-140cb9725bec-kube-api-access-4b6tr\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.079833 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.079208 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-sys\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.079833 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.079234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-cni-dir\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.087051 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.087032 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 21:50:14.121797 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.121661 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kh9vw" Jul 16 21:50:14.138582 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.138536 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kh9vw" Jul 16 21:50:14.165861 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.165838 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 21:50:14.170041 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.170019 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:50:14.179979 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.179956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdmfw\" (UniqueName: \"kubernetes.io/projected/cc9d6663-81ba-4b35-a262-48204ba79d29-kube-api-access-zdmfw\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.180086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.179991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-kubernetes\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.180086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-os-release\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.180086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-var-lib-cni-bin\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.180086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-conf-dir\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.180086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180089 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-kubernetes\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-socket-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98445a28-5caa-4485-9a1f-a0c7ee0ae943-kubelet-config\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180137 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-var-lib-cni-bin\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180154 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98445a28-5caa-4485-9a1f-a0c7ee0ae943-dbus\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-cnibin\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180199 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-os-release\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180232 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-node-log\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180256 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc9d6663-81ba-4b35-a262-48204ba79d29-ovnkube-config\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b2139b2-a6a2-4bd1-81df-140cb9725bec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k5wl\" (UniqueName: \"kubernetes.io/projected/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-kube-api-access-6k5wl\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180312 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4c2k\" (UniqueName: \"kubernetes.io/projected/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-kube-api-access-g4c2k\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18f81724-7fd6-40fd-a874-deae8fac08b0-host\") pod \"node-ca-8zcdj\" (UID: \"18f81724-7fd6-40fd-a874-deae8fac08b0\") " pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.180419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39c905d9-86aa-4365-a416-7512750c564b-iptables-alerter-script\") pod \"iptables-alerter-6rsqs\" (UID: \"39c905d9-86aa-4365-a416-7512750c564b\") " pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180439 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39c905d9-86aa-4365-a416-7512750c564b-host-slash\") pod \"iptables-alerter-6rsqs\" (UID: \"39c905d9-86aa-4365-a416-7512750c564b\") " pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-run\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-socket-dir-parent\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-cnibin\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-var-lib-kubelet\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180572 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-var-lib-kubelet\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-etc-openvswitch\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-cni-netd\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180626 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-run\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.180715 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180745 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-socket-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.180823 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs podName:7e4b8d92-3a02-482d-bc1f-61e537dd7409 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:14.680802492 +0000 UTC m=+2.982170779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs") pod "network-metrics-daemon-46cth" (UID: "7e4b8d92-3a02-482d-bc1f-61e537dd7409") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180819 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-socket-dir-parent\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-conf-dir\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qgq4\" (UniqueName: \"kubernetes.io/projected/18f81724-7fd6-40fd-a874-deae8fac08b0-kube-api-access-9qgq4\") pod \"node-ca-8zcdj\" (UID: \"18f81724-7fd6-40fd-a874-deae8fac08b0\") " pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-lib-modules\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.181179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180912 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39c905d9-86aa-4365-a416-7512750c564b-host-slash\") pod \"iptables-alerter-6rsqs\" (UID: \"39c905d9-86aa-4365-a416-7512750c564b\") " pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-var-lib-kubelet\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.180985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-host\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181012 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7nwp\" (UniqueName: \"kubernetes.io/projected/7c349ae3-b927-4208-8e83-37ae92534976-kube-api-access-g7nwp\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-lib-modules\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181068 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39c905d9-86aa-4365-a416-7512750c564b-iptables-alerter-script\") pod \"iptables-alerter-6rsqs\" (UID: \"39c905d9-86aa-4365-a416-7512750c564b\") " pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-var-lib-kubelet\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181138 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b2139b2-a6a2-4bd1-81df-140cb9725bec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-host\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181229 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181315 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-slash\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-run-openvswitch\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181449 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/21833623-82fa-42d0-9f6f-24fc6fd8a79b-hosts-file\") pod \"node-resolver-7rfmd\" (UID: \"21833623-82fa-42d0-9f6f-24fc6fd8a79b\") " pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.182042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18f81724-7fd6-40fd-a874-deae8fac08b0-serviceca\") pod \"node-ca-8zcdj\" (UID: \"18f81724-7fd6-40fd-a874-deae8fac08b0\") " pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181510 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc6128de-8fec-4aaf-883b-17d7ce474171-agent-certs\") pod \"konnectivity-agent-8hrxs\" (UID: \"bc6128de-8fec-4aaf-883b-17d7ce474171\") " pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6tr\" (UniqueName: \"kubernetes.io/projected/0b2139b2-a6a2-4bd1-81df-140cb9725bec-kube-api-access-4b6tr\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-var-lib-openvswitch\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-sys\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-cni-dir\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-kubelet\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181660 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-run-ovn\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-os-release\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-sysctl-conf\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-run-netns\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181757 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-var-lib-cni-multus\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181781 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-etc-kubernetes\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc9d6663-81ba-4b35-a262-48204ba79d29-ovn-node-metrics-cert\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lhzn\" (UniqueName: \"kubernetes.io/projected/21833623-82fa-42d0-9f6f-24fc6fd8a79b-kube-api-access-2lhzn\") pod \"node-resolver-7rfmd\" (UID: \"21833623-82fa-42d0-9f6f-24fc6fd8a79b\") " pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181897 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-system-cni-dir\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-sysconfig\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.182941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181968 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181999 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-os-release\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c349ae3-b927-4208-8e83-37ae92534976-etc-tuned\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182059 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-etc-kubernetes\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-system-cni-dir\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-hostroot\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.181989 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-sysconfig\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-run-netns\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182118 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-sysctl-conf\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96gvc\" (UniqueName: \"kubernetes.io/projected/7e4b8d92-3a02-482d-bc1f-61e537dd7409-kube-api-access-96gvc\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182154 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-run-ovn-kubernetes\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182174 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-var-lib-cni-multus\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182190 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b2139b2-a6a2-4bd1-81df-140cb9725bec-system-cni-dir\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-sysctl-d\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-sys\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-run-multus-certs\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182282 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-hostroot\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-run-systemd\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.183764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182308 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-cni-dir\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182360 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-system-cni-dir\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjt4b\" (UniqueName: \"kubernetes.io/projected/39c905d9-86aa-4365-a416-7512750c564b-kube-api-access-gjt4b\") pod \"iptables-alerter-6rsqs\" (UID: \"39c905d9-86aa-4365-a416-7512750c564b\") " pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c349ae3-b927-4208-8e83-37ae92534976-tmp\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182525 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-sysctl-d\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182542 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21833623-82fa-42d0-9f6f-24fc6fd8a79b-tmp-dir\") pod \"node-resolver-7rfmd\" (UID: \"21833623-82fa-42d0-9f6f-24fc6fd8a79b\") " pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182559 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-run-multus-certs\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b2139b2-a6a2-4bd1-81df-140cb9725bec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-cni-binary-copy\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-run-netns\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-systemd\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-cni-bin\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc9d6663-81ba-4b35-a262-48204ba79d29-env-overrides\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc9d6663-81ba-4b35-a262-48204ba79d29-ovnkube-script-lib\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.182833 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-systemd\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-modprobe-d\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.184752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-cnibin\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-run-k8s-cni-cncf-io\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183288 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-daemon-config\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183293 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b2139b2-a6a2-4bd1-81df-140cb9725bec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-registration-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-device-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183370 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-cni-binary-copy\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-sys-fs\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c349ae3-b927-4208-8e83-37ae92534976-etc-modprobe-d\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2139b2-a6a2-4bd1-81df-140cb9725bec-cni-binary-copy\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183436 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-host-run-k8s-cni-cncf-io\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183454 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc6128de-8fec-4aaf-883b-17d7ce474171-konnectivity-ca\") pod \"konnectivity-agent-8hrxs\" (UID: \"bc6128de-8fec-4aaf-883b-17d7ce474171\") " pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183482 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-device-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-systemd-units\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-log-socket\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183674 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-cnibin\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.185598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183728 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-registration-dir\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.186430 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-multus-daemon-config\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.186430 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.183993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-sys-fs\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.186430 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.184119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b2139b2-a6a2-4bd1-81df-140cb9725bec-cni-binary-copy\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.186430 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.184300 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc6128de-8fec-4aaf-883b-17d7ce474171-konnectivity-ca\") pod \"konnectivity-agent-8hrxs\" (UID: \"bc6128de-8fec-4aaf-883b-17d7ce474171\") " pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:14.186430 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.186169 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc6128de-8fec-4aaf-883b-17d7ce474171-agent-certs\") pod \"konnectivity-agent-8hrxs\" (UID: \"bc6128de-8fec-4aaf-883b-17d7ce474171\") " pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:14.186430 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.186196 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c349ae3-b927-4208-8e83-37ae92534976-etc-tuned\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.186430 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.186396 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c349ae3-b927-4208-8e83-37ae92534976-tmp\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.201806 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.201783 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4c2k\" (UniqueName: \"kubernetes.io/projected/eebcc38d-b96f-4a6f-95c5-7fc0342120fe-kube-api-access-g4c2k\") pod \"aws-ebs-csi-driver-node-kcqrw\" (UID: \"eebcc38d-b96f-4a6f-95c5-7fc0342120fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.203472 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.203441 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjt4b\" (UniqueName: \"kubernetes.io/projected/39c905d9-86aa-4365-a416-7512750c564b-kube-api-access-gjt4b\") pod \"iptables-alerter-6rsqs\" (UID: \"39c905d9-86aa-4365-a416-7512750c564b\") " pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.203644 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.203621 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:14.203644 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.203645 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:14.203812 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.203659 2580 projected.go:196] Error preparing data for projected volume kube-api-access-tv66w for pod openshift-network-diagnostics/network-check-target-dqmwr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:14.203812 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.203718 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w podName:04e0efc9-aef4-409d-b03c-d67ea93a95ad nodeName:}" failed. No retries permitted until 2026-07-16 21:50:14.703698093 +0000 UTC m=+3.005066395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tv66w" (UniqueName: "kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w") pod "network-check-target-dqmwr" (UID: "04e0efc9-aef4-409d-b03c-d67ea93a95ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:14.204928 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.204690 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k5wl\" (UniqueName: \"kubernetes.io/projected/7a0287d5-e389-4834-a1ac-afb4a4eb9e20-kube-api-access-6k5wl\") pod \"multus-t74t6\" (UID: \"7a0287d5-e389-4834-a1ac-afb4a4eb9e20\") " pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.204928 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.204759 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7nwp\" (UniqueName: \"kubernetes.io/projected/7c349ae3-b927-4208-8e83-37ae92534976-kube-api-access-g7nwp\") pod \"tuned-s44fz\" (UID: \"7c349ae3-b927-4208-8e83-37ae92534976\") " pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.204928 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.204885 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96gvc\" (UniqueName: \"kubernetes.io/projected/7e4b8d92-3a02-482d-bc1f-61e537dd7409-kube-api-access-96gvc\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:14.205124 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.205097 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6tr\" (UniqueName: \"kubernetes.io/projected/0b2139b2-a6a2-4bd1-81df-140cb9725bec-kube-api-access-4b6tr\") pod \"multus-additional-cni-plugins-hqsp4\" (UID: \"0b2139b2-a6a2-4bd1-81df-140cb9725bec\") " pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.234526 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.234479 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" event={"ID":"495397dc6f1a16a9be49692203c6b127","Type":"ContainerStarted","Data":"af233ecfd59d1e7bb98307a41c4454bec1e2b83ce7d7519f27c02ae4616ae947"} Jul 16 21:50:14.235824 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.235791 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal" event={"ID":"f7940344e37b0417b90f8d2a19bc8556","Type":"ContainerStarted","Data":"aadd3f9b06325ee22740a6c161cf310f4cb916c6127b79fdca72d10a29a6ac9c"} Jul 16 21:50:14.283919 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.283890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-run-ovn-kubernetes\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284057 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.283927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-run-systemd\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284057 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.283947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284057 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.283974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21833623-82fa-42d0-9f6f-24fc6fd8a79b-tmp-dir\") pod \"node-resolver-7rfmd\" (UID: \"21833623-82fa-42d0-9f6f-24fc6fd8a79b\") " pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.284057 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.283994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-run-netns\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284057 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-cni-bin\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284057 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc9d6663-81ba-4b35-a262-48204ba79d29-env-overrides\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc9d6663-81ba-4b35-a262-48204ba79d29-ovnkube-script-lib\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-systemd-units\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-log-socket\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmfw\" (UniqueName: \"kubernetes.io/projected/cc9d6663-81ba-4b35-a262-48204ba79d29-kube-api-access-zdmfw\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98445a28-5caa-4485-9a1f-a0c7ee0ae943-kubelet-config\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98445a28-5caa-4485-9a1f-a0c7ee0ae943-dbus\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-node-log\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc9d6663-81ba-4b35-a262-48204ba79d29-ovnkube-config\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284268 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18f81724-7fd6-40fd-a874-deae8fac08b0-host\") pod \"node-ca-8zcdj\" (UID: \"18f81724-7fd6-40fd-a874-deae8fac08b0\") " pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-etc-openvswitch\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-cni-netd\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qgq4\" (UniqueName: \"kubernetes.io/projected/18f81724-7fd6-40fd-a874-deae8fac08b0-kube-api-access-9qgq4\") pod \"node-ca-8zcdj\" (UID: \"18f81724-7fd6-40fd-a874-deae8fac08b0\") " pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.284364 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-slash\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-run-openvswitch\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284398 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98445a28-5caa-4485-9a1f-a0c7ee0ae943-kubelet-config\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284424 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-systemd-units\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/21833623-82fa-42d0-9f6f-24fc6fd8a79b-hosts-file\") pod \"node-resolver-7rfmd\" (UID: \"21833623-82fa-42d0-9f6f-24fc6fd8a79b\") " pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-log-socket\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284486 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/21833623-82fa-42d0-9f6f-24fc6fd8a79b-hosts-file\") pod \"node-resolver-7rfmd\" (UID: \"21833623-82fa-42d0-9f6f-24fc6fd8a79b\") " pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284492 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18f81724-7fd6-40fd-a874-deae8fac08b0-serviceca\") pod \"node-ca-8zcdj\" (UID: \"18f81724-7fd6-40fd-a874-deae8fac08b0\") " pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284502 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-run-ovn-kubernetes\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284523 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-var-lib-openvswitch\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284536 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-run-systemd\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284545 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98445a28-5caa-4485-9a1f-a0c7ee0ae943-dbus\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-kubelet\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284580 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-run-ovn\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284587 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc9d6663-81ba-4b35-a262-48204ba79d29-ovn-node-metrics-cert\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284625 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-node-log\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lhzn\" (UniqueName: \"kubernetes.io/projected/21833623-82fa-42d0-9f6f-24fc6fd8a79b-kube-api-access-2lhzn\") pod \"node-resolver-7rfmd\" (UID: \"21833623-82fa-42d0-9f6f-24fc6fd8a79b\") " pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.285066 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284688 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-cni-bin\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284925 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-var-lib-openvswitch\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.284966 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-kubelet\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285004 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-run-ovn\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285030 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21833623-82fa-42d0-9f6f-24fc6fd8a79b-tmp-dir\") pod \"node-resolver-7rfmd\" (UID: \"21833623-82fa-42d0-9f6f-24fc6fd8a79b\") " pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285030 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18f81724-7fd6-40fd-a874-deae8fac08b0-serviceca\") pod \"node-ca-8zcdj\" (UID: \"18f81724-7fd6-40fd-a874-deae8fac08b0\") " pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.285096 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-cni-netd\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.285151 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret podName:98445a28-5caa-4485-9a1f-a0c7ee0ae943 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:14.785133157 +0000 UTC m=+3.086501459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret") pod "global-pull-secret-syncer-5s4f7" (UID: "98445a28-5caa-4485-9a1f-a0c7ee0ae943") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285097 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-run-netns\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285154 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cc9d6663-81ba-4b35-a262-48204ba79d29-ovnkube-config\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285174 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18f81724-7fd6-40fd-a874-deae8fac08b0-host\") pod \"node-ca-8zcdj\" (UID: \"18f81724-7fd6-40fd-a874-deae8fac08b0\") " pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285222 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-etc-openvswitch\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285273 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-run-openvswitch\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285280 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc9d6663-81ba-4b35-a262-48204ba79d29-host-slash\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.285946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.285688 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cc9d6663-81ba-4b35-a262-48204ba79d29-ovnkube-script-lib\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.286616 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.286512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cc9d6663-81ba-4b35-a262-48204ba79d29-env-overrides\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.287820 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.287776 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc9d6663-81ba-4b35-a262-48204ba79d29-ovn-node-metrics-cert\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.300008 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.299952 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmfw\" (UniqueName: \"kubernetes.io/projected/cc9d6663-81ba-4b35-a262-48204ba79d29-kube-api-access-zdmfw\") pod \"ovnkube-node-24qjh\" (UID: \"cc9d6663-81ba-4b35-a262-48204ba79d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.309305 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.309281 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qgq4\" (UniqueName: \"kubernetes.io/projected/18f81724-7fd6-40fd-a874-deae8fac08b0-kube-api-access-9qgq4\") pod \"node-ca-8zcdj\" (UID: \"18f81724-7fd6-40fd-a874-deae8fac08b0\") " pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.310585 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.310555 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lhzn\" (UniqueName: \"kubernetes.io/projected/21833623-82fa-42d0-9f6f-24fc6fd8a79b-kube-api-access-2lhzn\") pod \"node-resolver-7rfmd\" (UID: \"21833623-82fa-42d0-9f6f-24fc6fd8a79b\") " pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.368299 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.368269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6rsqs" Jul 16 21:50:14.373335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.373313 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:14.377354 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:14.377327 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c905d9_86aa_4365_a416_7512750c564b.slice/crio-b94987e376976581e8434775fdf3143eb29c3b5bf4b16171be464a91769653b7 WatchSource:0}: Error finding container b94987e376976581e8434775fdf3143eb29c3b5bf4b16171be464a91769653b7: Status 404 returned error can't find the container with id b94987e376976581e8434775fdf3143eb29c3b5bf4b16171be464a91769653b7 Jul 16 21:50:14.383144 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.383054 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t74t6" Jul 16 21:50:14.383447 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:14.383424 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6128de_8fec_4aaf_883b_17d7ce474171.slice/crio-df03d70fa74e4e37426be51792aeebac9037d098b391316c39594c736221b8e5 WatchSource:0}: Error finding container df03d70fa74e4e37426be51792aeebac9037d098b391316c39594c736221b8e5: Status 404 returned error can't find the container with id df03d70fa74e4e37426be51792aeebac9037d098b391316c39594c736221b8e5 Jul 16 21:50:14.388462 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.388210 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" Jul 16 21:50:14.395670 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.395647 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" Jul 16 21:50:14.396739 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:14.396689 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0287d5_e389_4834_a1ac_afb4a4eb9e20.slice/crio-ac06ed66020b42033dcfa37c962893016f43880e39c52e977663028ee18904d4 WatchSource:0}: Error finding container ac06ed66020b42033dcfa37c962893016f43880e39c52e977663028ee18904d4: Status 404 returned error can't find the container with id ac06ed66020b42033dcfa37c962893016f43880e39c52e977663028ee18904d4 Jul 16 21:50:14.399560 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:14.399535 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2139b2_a6a2_4bd1_81df_140cb9725bec.slice/crio-05ed246c44995808f256a2f18b607437451c757e96e140b4bf24f3a7aeed3188 WatchSource:0}: Error finding container 05ed246c44995808f256a2f18b607437451c757e96e140b4bf24f3a7aeed3188: Status 404 returned error can't find the container with id 05ed246c44995808f256a2f18b607437451c757e96e140b4bf24f3a7aeed3188 Jul 16 21:50:14.403519 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.403501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s44fz" Jul 16 21:50:14.404434 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:14.404412 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeebcc38d_b96f_4a6f_95c5_7fc0342120fe.slice/crio-8bc501389a7c8170fa2cb54188ae021b41d7a0d9551f96f343fcc68a34db045d WatchSource:0}: Error finding container 8bc501389a7c8170fa2cb54188ae021b41d7a0d9551f96f343fcc68a34db045d: Status 404 returned error can't find the container with id 8bc501389a7c8170fa2cb54188ae021b41d7a0d9551f96f343fcc68a34db045d Jul 16 21:50:14.409254 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.409234 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7rfmd" Jul 16 21:50:14.412187 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:14.412163 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c349ae3_b927_4208_8e83_37ae92534976.slice/crio-8d7ae01fd8cd5d23bb5d7eb84c6a5d65164d4da149a3e7b67c9f012ba02483e4 WatchSource:0}: Error finding container 8d7ae01fd8cd5d23bb5d7eb84c6a5d65164d4da149a3e7b67c9f012ba02483e4: Status 404 returned error can't find the container with id 8d7ae01fd8cd5d23bb5d7eb84c6a5d65164d4da149a3e7b67c9f012ba02483e4 Jul 16 21:50:14.416869 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.416847 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8zcdj" Jul 16 21:50:14.417353 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:14.417332 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21833623_82fa_42d0_9f6f_24fc6fd8a79b.slice/crio-07fa58dd37e95441ca41a0765fe04671d758b035f1247bc99a67ed239ee5ebe7 WatchSource:0}: Error finding container 07fa58dd37e95441ca41a0765fe04671d758b035f1247bc99a67ed239ee5ebe7: Status 404 returned error can't find the container with id 07fa58dd37e95441ca41a0765fe04671d758b035f1247bc99a67ed239ee5ebe7 Jul 16 21:50:14.424079 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.424056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:14.426769 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:14.426747 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f81724_7fd6_40fd_a874_deae8fac08b0.slice/crio-271311ef1944a5f7d4b56314ae18f5dc105c54e79e7e0cdff3ca76a9d5c366f1 WatchSource:0}: Error finding container 271311ef1944a5f7d4b56314ae18f5dc105c54e79e7e0cdff3ca76a9d5c366f1: Status 404 returned error can't find the container with id 271311ef1944a5f7d4b56314ae18f5dc105c54e79e7e0cdff3ca76a9d5c366f1 Jul 16 21:50:14.432129 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:14.432110 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9d6663_81ba_4b35_a262_48204ba79d29.slice/crio-cc006a030a40234a89145c9071f866109686d376dda4eb110f6605e5879d76ea WatchSource:0}: Error finding container cc006a030a40234a89145c9071f866109686d376dda4eb110f6605e5879d76ea: Status 404 returned error can't find the container with id cc006a030a40234a89145c9071f866109686d376dda4eb110f6605e5879d76ea Jul 16 21:50:14.478651 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.478624 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:50:14.687497 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.687409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:14.687668 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.687618 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:14.687781 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.687756 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs podName:7e4b8d92-3a02-482d-bc1f-61e537dd7409 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:15.687708867 +0000 UTC m=+3.989077152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs") pod "network-metrics-daemon-46cth" (UID: "7e4b8d92-3a02-482d-bc1f-61e537dd7409") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:14.788576 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.788533 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:14.788762 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:14.788612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:14.788762 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.788750 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:14.788900 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.788783 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:14.788900 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.788802 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:14.788900 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.788816 2580 projected.go:196] Error preparing data for projected volume kube-api-access-tv66w for pod openshift-network-diagnostics/network-check-target-dqmwr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:14.788900 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.788837 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret podName:98445a28-5caa-4485-9a1f-a0c7ee0ae943 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:15.788814931 +0000 UTC m=+4.090183233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret") pod "global-pull-secret-syncer-5s4f7" (UID: "98445a28-5caa-4485-9a1f-a0c7ee0ae943") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:14.788900 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:14.788867 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w podName:04e0efc9-aef4-409d-b03c-d67ea93a95ad nodeName:}" failed. No retries permitted until 2026-07-16 21:50:15.78885104 +0000 UTC m=+4.090219328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv66w" (UniqueName: "kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w") pod "network-check-target-dqmwr" (UID: "04e0efc9-aef4-409d-b03c-d67ea93a95ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:15.140844 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.140740 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:45:14 +0000 UTC" deadline="2028-02-01 01:19:31.729873827 +0000 UTC" Jul 16 21:50:15.140844 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.140782 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13539h29m16.589097277s" Jul 16 21:50:15.240655 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.240599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8zcdj" event={"ID":"18f81724-7fd6-40fd-a874-deae8fac08b0","Type":"ContainerStarted","Data":"271311ef1944a5f7d4b56314ae18f5dc105c54e79e7e0cdff3ca76a9d5c366f1"} Jul 16 21:50:15.242664 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.242632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" event={"ID":"eebcc38d-b96f-4a6f-95c5-7fc0342120fe","Type":"ContainerStarted","Data":"8bc501389a7c8170fa2cb54188ae021b41d7a0d9551f96f343fcc68a34db045d"} Jul 16 21:50:15.246070 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.246042 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" event={"ID":"0b2139b2-a6a2-4bd1-81df-140cb9725bec","Type":"ContainerStarted","Data":"05ed246c44995808f256a2f18b607437451c757e96e140b4bf24f3a7aeed3188"} Jul 16 21:50:15.248185 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.248159 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t74t6" event={"ID":"7a0287d5-e389-4834-a1ac-afb4a4eb9e20","Type":"ContainerStarted","Data":"ac06ed66020b42033dcfa37c962893016f43880e39c52e977663028ee18904d4"} Jul 16 21:50:15.250277 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.250249 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8hrxs" event={"ID":"bc6128de-8fec-4aaf-883b-17d7ce474171","Type":"ContainerStarted","Data":"df03d70fa74e4e37426be51792aeebac9037d098b391316c39594c736221b8e5"} Jul 16 21:50:15.252619 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.252593 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6rsqs" event={"ID":"39c905d9-86aa-4365-a416-7512750c564b","Type":"ContainerStarted","Data":"b94987e376976581e8434775fdf3143eb29c3b5bf4b16171be464a91769653b7"} Jul 16 21:50:15.256769 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.256717 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerStarted","Data":"cc006a030a40234a89145c9071f866109686d376dda4eb110f6605e5879d76ea"} Jul 16 21:50:15.259030 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.259005 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7rfmd" event={"ID":"21833623-82fa-42d0-9f6f-24fc6fd8a79b","Type":"ContainerStarted","Data":"07fa58dd37e95441ca41a0765fe04671d758b035f1247bc99a67ed239ee5ebe7"} Jul 16 21:50:15.260369 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.260345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s44fz" event={"ID":"7c349ae3-b927-4208-8e83-37ae92534976","Type":"ContainerStarted","Data":"8d7ae01fd8cd5d23bb5d7eb84c6a5d65164d4da149a3e7b67c9f012ba02483e4"} Jul 16 21:50:15.697509 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.696946 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:15.697509 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:15.697094 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:15.697509 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:15.697158 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs podName:7e4b8d92-3a02-482d-bc1f-61e537dd7409 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:17.697138619 +0000 UTC m=+5.998506928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs") pod "network-metrics-daemon-46cth" (UID: "7e4b8d92-3a02-482d-bc1f-61e537dd7409") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:15.797612 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.797568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:15.797802 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:15.797640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:15.797893 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:15.797808 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:15.797893 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:15.797878 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret podName:98445a28-5caa-4485-9a1f-a0c7ee0ae943 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:17.797855592 +0000 UTC m=+6.099223893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret") pod "global-pull-secret-syncer-5s4f7" (UID: "98445a28-5caa-4485-9a1f-a0c7ee0ae943") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:15.798350 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:15.798319 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:15.798350 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:15.798349 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:15.798516 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:15.798363 2580 projected.go:196] Error preparing data for projected volume kube-api-access-tv66w for pod openshift-network-diagnostics/network-check-target-dqmwr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:15.798516 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:15.798414 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w podName:04e0efc9-aef4-409d-b03c-d67ea93a95ad nodeName:}" failed. No retries permitted until 2026-07-16 21:50:17.798396434 +0000 UTC m=+6.099764718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv66w" (UniqueName: "kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w") pod "network-check-target-dqmwr" (UID: "04e0efc9-aef4-409d-b03c-d67ea93a95ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:16.141383 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:16.141312 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:45:14 +0000 UTC" deadline="2027-12-29 15:18:06.886862259 +0000 UTC" Jul 16 21:50:16.141383 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:16.141354 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12737h27m50.745513629s" Jul 16 21:50:16.231822 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:16.230934 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:16.231822 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:16.231077 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:16.231822 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:16.231511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:16.231822 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:16.231609 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:16.231822 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:16.231671 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:16.231822 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:16.231740 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:17.714811 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:17.714154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:17.714811 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:17.714331 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:17.714811 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:17.714398 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs podName:7e4b8d92-3a02-482d-bc1f-61e537dd7409 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:21.714379689 +0000 UTC m=+10.015747979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs") pod "network-metrics-daemon-46cth" (UID: "7e4b8d92-3a02-482d-bc1f-61e537dd7409") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:17.815573 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:17.814595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:17.815573 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:17.814709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:17.815573 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:17.814876 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:17.815573 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:17.814898 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:17.815573 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:17.814913 2580 projected.go:196] Error preparing data for projected volume kube-api-access-tv66w for pod openshift-network-diagnostics/network-check-target-dqmwr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:17.815573 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:17.814973 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w podName:04e0efc9-aef4-409d-b03c-d67ea93a95ad nodeName:}" failed. No retries permitted until 2026-07-16 21:50:21.814954398 +0000 UTC m=+10.116322691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv66w" (UniqueName: "kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w") pod "network-check-target-dqmwr" (UID: "04e0efc9-aef4-409d-b03c-d67ea93a95ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:17.815573 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:17.815395 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:17.815573 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:17.815449 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret podName:98445a28-5caa-4485-9a1f-a0c7ee0ae943 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:21.815432653 +0000 UTC m=+10.116800940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret") pod "global-pull-secret-syncer-5s4f7" (UID: "98445a28-5caa-4485-9a1f-a0c7ee0ae943") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:18.230951 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:18.230914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:18.231162 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:18.231060 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:18.231431 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:18.230914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:18.231556 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:18.231530 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:18.231729 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:18.231694 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:18.231842 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:18.231805 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:20.230375 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:20.230342 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:20.230375 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:20.230379 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:20.230955 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:20.230342 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:20.230955 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:20.230498 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:20.230955 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:20.230581 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:20.230955 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:20.230661 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:21.749166 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:21.749122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:21.749640 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:21.749291 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:21.749640 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:21.749370 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs podName:7e4b8d92-3a02-482d-bc1f-61e537dd7409 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:29.749349236 +0000 UTC m=+18.050717541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs") pod "network-metrics-daemon-46cth" (UID: "7e4b8d92-3a02-482d-bc1f-61e537dd7409") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:21.850652 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:21.850490 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:21.850652 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:21.850557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:21.850874 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:21.850682 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:21.850874 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:21.850700 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:21.850874 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:21.850723 2580 projected.go:196] Error preparing data for projected volume kube-api-access-tv66w for pod openshift-network-diagnostics/network-check-target-dqmwr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:21.850874 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:21.850775 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w podName:04e0efc9-aef4-409d-b03c-d67ea93a95ad nodeName:}" failed. No retries permitted until 2026-07-16 21:50:29.85076156 +0000 UTC m=+18.152129846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv66w" (UniqueName: "kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w") pod "network-check-target-dqmwr" (UID: "04e0efc9-aef4-409d-b03c-d67ea93a95ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:21.850874 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:21.850850 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:21.851061 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:21.850893 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret podName:98445a28-5caa-4485-9a1f-a0c7ee0ae943 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:29.850882372 +0000 UTC m=+18.152250669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret") pod "global-pull-secret-syncer-5s4f7" (UID: "98445a28-5caa-4485-9a1f-a0c7ee0ae943") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:22.230725 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:22.230683 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:22.230909 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:22.230798 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:22.230909 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:22.230831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:22.230909 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:22.230872 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:22.231066 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:22.230915 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:22.231066 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:22.230960 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:24.230164 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:24.230131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:24.230605 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:24.230131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:24.230605 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:24.230270 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:24.230605 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:24.230353 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:24.230605 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:24.230131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:24.230605 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:24.230445 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:26.230136 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:26.230100 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:26.230573 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:26.230110 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:26.230573 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:26.230222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:26.230573 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:26.230213 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:26.230573 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:26.230298 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:26.230573 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:26.230384 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:28.230123 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:28.230081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:28.230569 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:28.230081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:28.230569 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:28.230451 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:28.230569 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:28.230095 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:28.232908 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:28.230782 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:28.232908 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:28.230946 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:29.811921 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:29.811878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:29.812409 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:29.812050 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:29.812409 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:29.812137 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs podName:7e4b8d92-3a02-482d-bc1f-61e537dd7409 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.812115969 +0000 UTC m=+34.113484251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs") pod "network-metrics-daemon-46cth" (UID: "7e4b8d92-3a02-482d-bc1f-61e537dd7409") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:29.912275 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:29.912236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:29.912473 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:29.912302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:29.912473 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:29.912415 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:29.912611 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:29.912494 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret podName:98445a28-5caa-4485-9a1f-a0c7ee0ae943 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.912458644 +0000 UTC m=+34.213826928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret") pod "global-pull-secret-syncer-5s4f7" (UID: "98445a28-5caa-4485-9a1f-a0c7ee0ae943") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:29.912611 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:29.912418 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:29.912611 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:29.912532 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:29.912611 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:29.912548 2580 projected.go:196] Error preparing data for projected volume kube-api-access-tv66w for pod openshift-network-diagnostics/network-check-target-dqmwr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:29.912611 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:29.912606 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w podName:04e0efc9-aef4-409d-b03c-d67ea93a95ad nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.912590712 +0000 UTC m=+34.213959014 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv66w" (UniqueName: "kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w") pod "network-check-target-dqmwr" (UID: "04e0efc9-aef4-409d-b03c-d67ea93a95ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:30.230098 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:30.230054 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:30.230098 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:30.230076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:30.230315 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:30.230062 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:30.230315 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:30.230188 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:30.230315 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:30.230249 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:30.230409 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:30.230328 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:32.230522 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:32.230316 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:32.230993 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:32.230403 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:32.230993 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:32.230608 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:32.230993 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:32.230435 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:32.230993 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:32.230635 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:32.230993 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:32.230763 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:34.230185 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:34.230155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:34.230632 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:34.230155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:34.230632 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:34.230275 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:34.230632 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:34.230164 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:34.230632 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:34.230360 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:34.230632 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:34.230441 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:34.309958 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:34.309921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal" event={"ID":"f7940344e37b0417b90f8d2a19bc8556","Type":"ContainerStarted","Data":"0618e61299df6d7d5f02cc86f2432ee103d8de813df5a3ca66c7c63dc7606f0d"} Jul 16 21:50:34.311415 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:34.311381 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t74t6" event={"ID":"7a0287d5-e389-4834-a1ac-afb4a4eb9e20","Type":"ContainerStarted","Data":"fcbc5dd9060c04edb738c87edba32128578843d1c1cb35dcb422309ce619c0bc"} Jul 16 21:50:34.312788 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:34.312758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s44fz" event={"ID":"7c349ae3-b927-4208-8e83-37ae92534976","Type":"ContainerStarted","Data":"3a7fbdf4d4d484fa95df4fad4571fae2392bc2400db26862a69b46d7b184919f"} Jul 16 21:50:34.374262 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:34.374199 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-247.ec2.internal" podStartSLOduration=20.374175692 podStartE2EDuration="20.374175692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:34.346829913 +0000 UTC m=+22.648198215" watchObservedRunningTime="2026-07-16 21:50:34.374175692 +0000 UTC m=+22.675544060" Jul 16 21:50:34.374990 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:34.374929 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s44fz" podStartSLOduration=2.045833575 podStartE2EDuration="21.374912732s" totalImagesPullingTime="19.329079157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:34.374113855 +0000 UTC m=+22.675482161" watchObservedRunningTime="2026-07-16 21:50:34.374912732 +0000 UTC m=+22.676281037" Jul 16 21:50:35.317536 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.317181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6rsqs" event={"ID":"39c905d9-86aa-4365-a416-7512750c564b","Type":"ContainerStarted","Data":"aa238a7dfe681c037fbcdfb5fead8862ff62ceffaa3c42d2cd85ad18449a2800"} Jul 16 21:50:35.320621 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.320419 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 21:50:35.321337 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.321305 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerStarted","Data":"df5a77e8c1fa775f31e89b2d42551a9b186fe0d4df063302318da90652d52987"} Jul 16 21:50:35.321464 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.321387 2580 generic.go:356] "Generic (PLEG): container finished" podID="cc9d6663-81ba-4b35-a262-48204ba79d29" containerID="2a755b1c917ae52264cece9352a7946676deb63645ac1c0539b5f94d5d041932" exitCode=1 Jul 16 21:50:35.321528 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.321484 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerStarted","Data":"504205f8e8a5d6c8134047d7ed740fb03d77e5b3ad1efb5e0d7a7c0000c5a778"} Jul 16 21:50:35.321586 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.321572 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerStarted","Data":"2ef95a8168dc2bb8be4648501dc96a52e71d23d4b8d67847465b39c14bb29b2a"} Jul 16 21:50:35.321657 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.321643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerStarted","Data":"51dcde49999afc45dfe39d57c772f4a9254616c1f3992a436aec4488744d20b9"} Jul 16 21:50:35.321741 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.321728 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerDied","Data":"2a755b1c917ae52264cece9352a7946676deb63645ac1c0539b5f94d5d041932"} Jul 16 21:50:35.321811 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.321798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerStarted","Data":"f02603d9e415d67842b17a7dc1bbe913edba5dbabfe3254afe7b3b2145faecf5"} Jul 16 21:50:35.325455 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.325426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7rfmd" event={"ID":"21833623-82fa-42d0-9f6f-24fc6fd8a79b","Type":"ContainerStarted","Data":"8076ef2e04a6129265cfca62e6329937ea35a59a561c24016738c0deeebf8c25"} Jul 16 21:50:35.326945 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.326918 2580 generic.go:356] "Generic (PLEG): container finished" podID="495397dc6f1a16a9be49692203c6b127" containerID="b7a49e7fa155389005386f24da4cf22135f73225a1772d42454dbf1110f3b1c9" exitCode=0 Jul 16 21:50:35.327055 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.326994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" event={"ID":"495397dc6f1a16a9be49692203c6b127","Type":"ContainerDied","Data":"b7a49e7fa155389005386f24da4cf22135f73225a1772d42454dbf1110f3b1c9"} Jul 16 21:50:35.328564 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.328531 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8zcdj" event={"ID":"18f81724-7fd6-40fd-a874-deae8fac08b0","Type":"ContainerStarted","Data":"0d5e86024f90b968bf119b98ca5b0414ac45335fc93011f946ce6bcea38dfbee"} Jul 16 21:50:35.330366 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.330341 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" event={"ID":"eebcc38d-b96f-4a6f-95c5-7fc0342120fe","Type":"ContainerStarted","Data":"623d142f361256c6011459f376ede78391c81c5ecaf9b91268e1f8fa417ae2a5"} Jul 16 21:50:35.331941 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.331908 2580 generic.go:356] "Generic (PLEG): container finished" podID="0b2139b2-a6a2-4bd1-81df-140cb9725bec" containerID="8c88453b734027000cd2c3c4cf22ca9d1fbb04f6dac38ad581bf0e4818a2462a" exitCode=0 Jul 16 21:50:35.332047 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.331954 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" event={"ID":"0b2139b2-a6a2-4bd1-81df-140cb9725bec","Type":"ContainerDied","Data":"8c88453b734027000cd2c3c4cf22ca9d1fbb04f6dac38ad581bf0e4818a2462a"} Jul 16 21:50:35.333581 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.333560 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8hrxs" event={"ID":"bc6128de-8fec-4aaf-883b-17d7ce474171","Type":"ContainerStarted","Data":"8053f8c00082f0977b35b0f31c7415a6ce8d8879d87273797d6e7b5098f4dba0"} Jul 16 21:50:35.341211 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.341170 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t74t6" podStartSLOduration=2.986412015 podStartE2EDuration="22.34115699s" totalImagesPullingTime="19.354744975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:34.407794319 +0000 UTC m=+22.709162623" watchObservedRunningTime="2026-07-16 21:50:35.34115699 +0000 UTC m=+23.642525295" Jul 16 21:50:35.341413 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.341387 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6rsqs" podStartSLOduration=3.980021253 podStartE2EDuration="23.341379649s" totalImagesPullingTime="19.361358396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:35.341087612 +0000 UTC m=+23.642455916" watchObservedRunningTime="2026-07-16 21:50:35.341379649 +0000 UTC m=+23.642747953" Jul 16 21:50:35.367101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.367004 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8hrxs" podStartSLOduration=4.009402316 podStartE2EDuration="23.366982932s" totalImagesPullingTime="19.357580616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:35.36685615 +0000 UTC m=+23.668224455" watchObservedRunningTime="2026-07-16 21:50:35.366982932 +0000 UTC m=+23.668351237" Jul 16 21:50:35.393894 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.393846 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7rfmd" podStartSLOduration=3.47408337 podStartE2EDuration="22.393825661s" totalImagesPullingTime="18.919742291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:35.393480134 +0000 UTC m=+23.694848438" watchObservedRunningTime="2026-07-16 21:50:35.393825661 +0000 UTC m=+23.695193966" Jul 16 21:50:35.436022 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:35.435983 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8zcdj" podStartSLOduration=11.186344061 podStartE2EDuration="22.435971928s" totalImagesPullingTime="11.249627867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:35.435441051 +0000 UTC m=+23.736809355" watchObservedRunningTime="2026-07-16 21:50:35.435971928 +0000 UTC m=+23.737340257" Jul 16 21:50:36.064929 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.064909 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 21:50:36.141099 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.140973 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T21:50:36.064928209Z","UUID":"b92e679a-a17a-4d95-9885-58d39bcdf379","Handler":null,"Name":"","Endpoint":""} Jul 16 21:50:36.142582 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.142558 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 21:50:36.142691 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.142595 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 21:50:36.229965 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.229920 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:36.230158 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:36.230060 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:36.230158 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.229922 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:36.230158 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.229922 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:36.230542 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:36.230512 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:36.233370 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:36.230162 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:36.337955 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.337909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" event={"ID":"eebcc38d-b96f-4a6f-95c5-7fc0342120fe","Type":"ContainerStarted","Data":"ed6771be5147ada0113adb4d3d9499f5cdaa02e328083dbbfe22636377603ab7"} Jul 16 21:50:36.340034 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.339996 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" event={"ID":"495397dc6f1a16a9be49692203c6b127","Type":"ContainerStarted","Data":"74d366299726fcb7ac48fb9f338e86eaedddf0ef95c1ea7d22fa4b8122b13a61"} Jul 16 21:50:36.356900 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:36.356846 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-247.ec2.internal" podStartSLOduration=22.356831168 podStartE2EDuration="22.356831168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:36.356469407 +0000 UTC m=+24.657837712" watchObservedRunningTime="2026-07-16 21:50:36.356831168 +0000 UTC m=+24.658199471" Jul 16 21:50:37.345953 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:37.345930 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 21:50:37.346340 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:37.346314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerStarted","Data":"96ac5d3203bce0bc7b341bdad7ce56c8e7a79e43d9346f748b1f9d87a20fc7c8"} Jul 16 21:50:37.348522 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:37.348497 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" event={"ID":"eebcc38d-b96f-4a6f-95c5-7fc0342120fe","Type":"ContainerStarted","Data":"8b5986403e95965c5c6b163ac28f8f208db398fa3622dc28465c96f8f5eb93a9"} Jul 16 21:50:37.371622 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:37.371573 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcqrw" podStartSLOduration=2.770848562 podStartE2EDuration="24.371555414s" totalImagesPullingTime="21.600706852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:37.371348829 +0000 UTC m=+25.672717133" watchObservedRunningTime="2026-07-16 21:50:37.371555414 +0000 UTC m=+25.672923719" Jul 16 21:50:38.230086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:38.230049 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:38.230262 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:38.230090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:38.230262 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:38.230111 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:38.230262 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:38.230237 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:38.230429 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:38.230315 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:38.230483 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:38.230412 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:40.148915 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.148665 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:40.149547 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.149244 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:40.230446 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.230413 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:40.230612 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.230413 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:40.230612 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:40.230510 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:40.230612 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.230413 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:40.230612 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:40.230600 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:40.230847 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:40.230681 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:40.355824 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.355743 2580 generic.go:356] "Generic (PLEG): container finished" podID="0b2139b2-a6a2-4bd1-81df-140cb9725bec" containerID="bf1ccc5d9816e20d6660027ef560f911bcc5aef95c24e5908566885d41a340a2" exitCode=0 Jul 16 21:50:40.355999 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.355827 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" event={"ID":"0b2139b2-a6a2-4bd1-81df-140cb9725bec","Type":"ContainerDied","Data":"bf1ccc5d9816e20d6660027ef560f911bcc5aef95c24e5908566885d41a340a2"} Jul 16 21:50:40.359102 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.359085 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 21:50:40.359512 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.359488 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerStarted","Data":"10a049875dec165dcb6e3868d1b8a760b0500ac8603f0b8c2a98ebbe6aece56d"} Jul 16 21:50:40.359671 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.359659 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:40.359967 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.359952 2580 scope.go:117] "RemoveContainer" containerID="2a755b1c917ae52264cece9352a7946676deb63645ac1c0539b5f94d5d041932" Jul 16 21:50:40.360408 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:40.360395 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8hrxs" Jul 16 21:50:41.367936 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.367912 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 21:50:41.369248 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.368623 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" event={"ID":"cc9d6663-81ba-4b35-a262-48204ba79d29","Type":"ContainerStarted","Data":"0f41753953b0e38e44a46b84f5d9d8a0cb246114ef176b504742ac44099c791e"} Jul 16 21:50:41.369248 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.369107 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:41.369248 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.369177 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:41.369248 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.369227 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:41.387509 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.387489 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:41.387603 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.387582 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:50:41.404445 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.404396 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" podStartSLOduration=8.54175984 podStartE2EDuration="28.404380705s" totalImagesPullingTime="19.862620865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:41.402983028 +0000 UTC m=+29.704351344" watchObservedRunningTime="2026-07-16 21:50:41.404380705 +0000 UTC m=+29.705749008" Jul 16 21:50:41.567798 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.567692 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-46cth"] Jul 16 21:50:41.567929 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.567829 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:41.567993 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:41.567938 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:41.570670 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.570649 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqmwr"] Jul 16 21:50:41.570806 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.570774 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:41.570904 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:41.570868 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:41.571397 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.571374 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5s4f7"] Jul 16 21:50:41.571476 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:41.571458 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:41.571544 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:41.571523 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:42.374506 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:42.374469 2580 generic.go:356] "Generic (PLEG): container finished" podID="0b2139b2-a6a2-4bd1-81df-140cb9725bec" containerID="15d54ec24c617cdc8bf741cf3fb67587f7c730bc03abe388248ee08d470a2d07" exitCode=0 Jul 16 21:50:42.374968 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:42.374556 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" event={"ID":"0b2139b2-a6a2-4bd1-81df-140cb9725bec","Type":"ContainerDied","Data":"15d54ec24c617cdc8bf741cf3fb67587f7c730bc03abe388248ee08d470a2d07"} Jul 16 21:50:43.229692 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:43.229652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:43.230004 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:43.229700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:43.230004 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:43.229668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:43.230004 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:43.229795 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:43.230004 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:43.229889 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:43.230004 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:43.229976 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:44.381316 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:44.381284 2580 generic.go:356] "Generic (PLEG): container finished" podID="0b2139b2-a6a2-4bd1-81df-140cb9725bec" containerID="7a0f7d58eebf0b690ca389a337ee0117e18e736ace6967f19a84473f06bfcd4a" exitCode=0 Jul 16 21:50:44.381770 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:44.381338 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" event={"ID":"0b2139b2-a6a2-4bd1-81df-140cb9725bec","Type":"ContainerDied","Data":"7a0f7d58eebf0b690ca389a337ee0117e18e736ace6967f19a84473f06bfcd4a"} Jul 16 21:50:45.230323 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:45.230286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:45.230323 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:45.230308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:45.230323 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:45.230286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:45.230597 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.230433 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5s4f7" podUID="98445a28-5caa-4485-9a1f-a0c7ee0ae943" Jul 16 21:50:45.230597 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.230466 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-46cth" podUID="7e4b8d92-3a02-482d-bc1f-61e537dd7409" Jul 16 21:50:45.230597 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.230563 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqmwr" podUID="04e0efc9-aef4-409d-b03c-d67ea93a95ad" Jul 16 21:50:45.839618 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:45.839578 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:45.840081 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.839736 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:45.840081 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.839810 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs podName:7e4b8d92-3a02-482d-bc1f-61e537dd7409 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:17.839789644 +0000 UTC m=+66.141157940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs") pod "network-metrics-daemon-46cth" (UID: "7e4b8d92-3a02-482d-bc1f-61e537dd7409") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:45.940700 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:45.940666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:45.940879 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:45.940742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:45.940947 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.940872 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:45.940947 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.940895 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:45.940947 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.940906 2580 projected.go:196] Error preparing data for projected volume kube-api-access-tv66w for pod openshift-network-diagnostics/network-check-target-dqmwr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:45.941090 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.940953 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w podName:04e0efc9-aef4-409d-b03c-d67ea93a95ad nodeName:}" failed. No retries permitted until 2026-07-16 21:51:17.940938713 +0000 UTC m=+66.242306995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv66w" (UniqueName: "kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w") pod "network-check-target-dqmwr" (UID: "04e0efc9-aef4-409d-b03c-d67ea93a95ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:45.941090 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.941020 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:45.941090 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:45.941087 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret podName:98445a28-5caa-4485-9a1f-a0c7ee0ae943 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:17.941070904 +0000 UTC m=+66.242439191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret") pod "global-pull-secret-syncer-5s4f7" (UID: "98445a28-5caa-4485-9a1f-a0c7ee0ae943") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:47.011835 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.011631 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-247.ec2.internal" event="NodeReady" Jul 16 21:50:47.012267 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.011941 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 21:50:47.073095 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.073054 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt"] Jul 16 21:50:47.075309 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.075287 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.078345 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.078326 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 21:50:47.078441 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.078331 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 21:50:47.079075 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.079058 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 21:50:47.082042 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.082027 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kmpcf\"" Jul 16 21:50:47.096320 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.096297 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 21:50:47.110668 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.110649 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt"] Jul 16 21:50:47.118550 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.118528 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rssrk"] Jul 16 21:50:47.120443 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.120426 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.125883 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.125773 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 21:50:47.125968 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.125884 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 21:50:47.125968 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.125899 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4vmw\"" Jul 16 21:50:47.134363 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.134341 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-68xvq"] Jul 16 21:50:47.136294 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.136230 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-68xvq" Jul 16 21:50:47.138778 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.138740 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rssrk"] Jul 16 21:50:47.140534 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.140304 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 21:50:47.140961 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.140930 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 21:50:47.141176 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.141157 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-khfb2\"" Jul 16 21:50:47.141415 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.141390 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 21:50:47.156702 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.156682 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-68xvq"] Jul 16 21:50:47.230360 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.230323 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:50:47.230559 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.230371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:50:47.230559 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.230371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:50:47.234274 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.234243 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 21:50:47.234569 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.234542 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 21:50:47.234659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.234581 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 21:50:47.234659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.234604 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5fdwm\"" Jul 16 21:50:47.234659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.234548 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 21:50:47.234996 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.234969 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wslpm\"" Jul 16 21:50:47.251547 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.251684 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251549 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-trusted-ca\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.251684 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqt8s\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-kube-api-access-fqt8s\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.251684 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-config-volume\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.251684 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-tmp-dir\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.251684 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11aa9c9-ff28-4085-b6ed-2fa149846ee7-cert\") pod \"ingress-canary-68xvq\" (UID: \"f11aa9c9-ff28-4085-b6ed-2fa149846ee7\") " pod="openshift-ingress-canary/ingress-canary-68xvq" Jul 16 21:50:47.251963 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-certificates\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.251963 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbjg2\" (UniqueName: \"kubernetes.io/projected/f11aa9c9-ff28-4085-b6ed-2fa149846ee7-kube-api-access-bbjg2\") pod \"ingress-canary-68xvq\" (UID: \"f11aa9c9-ff28-4085-b6ed-2fa149846ee7\") " pod="openshift-ingress-canary/ingress-canary-68xvq" Jul 16 21:50:47.251963 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/550b8482-d6ca-4f12-a727-e867f6f2ac9d-ca-trust-extracted\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.251963 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-bound-sa-token\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.251963 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d72zv\" (UniqueName: \"kubernetes.io/projected/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-kube-api-access-d72zv\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.252153 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.251976 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-image-registry-private-configuration\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.252153 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.252003 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-installation-pull-secrets\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.252153 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.252033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.353388 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/550b8482-d6ca-4f12-a727-e867f6f2ac9d-ca-trust-extracted\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.353388 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-bound-sa-token\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.353607 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d72zv\" (UniqueName: \"kubernetes.io/projected/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-kube-api-access-d72zv\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.353671 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-image-registry-private-configuration\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.353671 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-installation-pull-secrets\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.353671 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.353872 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.353872 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-trusted-ca\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.353872 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353776 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/550b8482-d6ca-4f12-a727-e867f6f2ac9d-ca-trust-extracted\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.353872 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353801 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqt8s\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-kube-api-access-fqt8s\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.353872 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-config-volume\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.353872 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353854 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-tmp-dir\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.354148 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353876 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11aa9c9-ff28-4085-b6ed-2fa149846ee7-cert\") pod \"ingress-canary-68xvq\" (UID: \"f11aa9c9-ff28-4085-b6ed-2fa149846ee7\") " pod="openshift-ingress-canary/ingress-canary-68xvq" Jul 16 21:50:47.354148 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.353883 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:47.354148 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-certificates\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.354148 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.353943 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls podName:697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:47.853922443 +0000 UTC m=+36.155290743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls") pod "dns-default-rssrk" (UID: "697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c") : secret "dns-default-metrics-tls" not found Jul 16 21:50:47.354148 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.353983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbjg2\" (UniqueName: \"kubernetes.io/projected/f11aa9c9-ff28-4085-b6ed-2fa149846ee7-kube-api-access-bbjg2\") pod \"ingress-canary-68xvq\" (UID: \"f11aa9c9-ff28-4085-b6ed-2fa149846ee7\") " pod="openshift-ingress-canary/ingress-canary-68xvq" Jul 16 21:50:47.354462 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.354442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-certificates\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.354603 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.354498 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:47.354603 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.354514 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt: secret "image-registry-tls" not found Jul 16 21:50:47.354603 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.354555 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls podName:550b8482-d6ca-4f12-a727-e867f6f2ac9d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:47.854540966 +0000 UTC m=+36.155909254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls") pod "image-registry-6b7c6b9fd5-lmsxt" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d") : secret "image-registry-tls" not found Jul 16 21:50:47.354780 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.354635 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-tmp-dir\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.355096 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.355067 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-config-volume\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.355360 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.355343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-trusted-ca\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.358581 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.358562 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-image-registry-private-configuration\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.358701 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.358586 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f11aa9c9-ff28-4085-b6ed-2fa149846ee7-cert\") pod \"ingress-canary-68xvq\" (UID: \"f11aa9c9-ff28-4085-b6ed-2fa149846ee7\") " pod="openshift-ingress-canary/ingress-canary-68xvq" Jul 16 21:50:47.358701 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.358636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-installation-pull-secrets\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.364343 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.364191 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqt8s\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-kube-api-access-fqt8s\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.364498 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.364437 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbjg2\" (UniqueName: \"kubernetes.io/projected/f11aa9c9-ff28-4085-b6ed-2fa149846ee7-kube-api-access-bbjg2\") pod \"ingress-canary-68xvq\" (UID: \"f11aa9c9-ff28-4085-b6ed-2fa149846ee7\") " pod="openshift-ingress-canary/ingress-canary-68xvq" Jul 16 21:50:47.364806 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.364773 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d72zv\" (UniqueName: \"kubernetes.io/projected/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-kube-api-access-d72zv\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.366260 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.366238 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-bound-sa-token\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.451013 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.450978 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-68xvq" Jul 16 21:50:47.859149 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.859112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:47.859319 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:47.859164 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:47.859319 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.859293 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:47.859319 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.859297 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:47.859496 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.859382 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls podName:697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:48.859360171 +0000 UTC m=+37.160728458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls") pod "dns-default-rssrk" (UID: "697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c") : secret "dns-default-metrics-tls" not found Jul 16 21:50:47.859496 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.859309 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt: secret "image-registry-tls" not found Jul 16 21:50:47.859496 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:47.859480 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls podName:550b8482-d6ca-4f12-a727-e867f6f2ac9d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:48.859458952 +0000 UTC m=+37.160827266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls") pod "image-registry-6b7c6b9fd5-lmsxt" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d") : secret "image-registry-tls" not found Jul 16 21:50:48.386974 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.386945 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-68xvq"] Jul 16 21:50:48.390486 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:48.390455 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11aa9c9_ff28_4085_b6ed_2fa149846ee7.slice/crio-e03956c777af25a12a75e1ff774df910de59976eeaa58fdde4d5016c6924797d WatchSource:0}: Error finding container e03956c777af25a12a75e1ff774df910de59976eeaa58fdde4d5016c6924797d: Status 404 returned error can't find the container with id e03956c777af25a12a75e1ff774df910de59976eeaa58fdde4d5016c6924797d Jul 16 21:50:48.545220 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.545002 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f"] Jul 16 21:50:48.547154 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.547139 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f" Jul 16 21:50:48.549869 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.549848 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 21:50:48.550138 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.550115 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4f6s7\"" Jul 16 21:50:48.550238 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.550179 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 21:50:48.559866 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.559848 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f"] Jul 16 21:50:48.665381 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.665356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mmfc\" (UniqueName: \"kubernetes.io/projected/8dc6907a-8be0-4251-bada-6e89c4c81ef8-kube-api-access-6mmfc\") pod \"migrator-7cc9c7ffd7-r4k7f\" (UID: \"8dc6907a-8be0-4251-bada-6e89c4c81ef8\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f" Jul 16 21:50:48.766025 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.765996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mmfc\" (UniqueName: \"kubernetes.io/projected/8dc6907a-8be0-4251-bada-6e89c4c81ef8-kube-api-access-6mmfc\") pod \"migrator-7cc9c7ffd7-r4k7f\" (UID: \"8dc6907a-8be0-4251-bada-6e89c4c81ef8\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f" Jul 16 21:50:48.774477 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.774458 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mmfc\" (UniqueName: \"kubernetes.io/projected/8dc6907a-8be0-4251-bada-6e89c4c81ef8-kube-api-access-6mmfc\") pod \"migrator-7cc9c7ffd7-r4k7f\" (UID: \"8dc6907a-8be0-4251-bada-6e89c4c81ef8\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f" Jul 16 21:50:48.855484 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.855361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f" Jul 16 21:50:48.866583 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.866560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:48.866698 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.866611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:48.866775 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:48.866752 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:48.866775 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:48.866769 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt: secret "image-registry-tls" not found Jul 16 21:50:48.866870 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:48.866811 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:48.866870 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:48.866832 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls podName:550b8482-d6ca-4f12-a727-e867f6f2ac9d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:50.866813391 +0000 UTC m=+39.168181691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls") pod "image-registry-6b7c6b9fd5-lmsxt" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d") : secret "image-registry-tls" not found Jul 16 21:50:48.866970 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:48.866876 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls podName:697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:50.866854357 +0000 UTC m=+39.168222644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls") pod "dns-default-rssrk" (UID: "697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c") : secret "dns-default-metrics-tls" not found Jul 16 21:50:48.991161 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:48.991131 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f"] Jul 16 21:50:48.994259 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:50:48.994237 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc6907a_8be0_4251_bada_6e89c4c81ef8.slice/crio-10432034d2a93c4a642e10a4a34150d3c2c5eb922e884c414ff1b068af1da8f6 WatchSource:0}: Error finding container 10432034d2a93c4a642e10a4a34150d3c2c5eb922e884c414ff1b068af1da8f6: Status 404 returned error can't find the container with id 10432034d2a93c4a642e10a4a34150d3c2c5eb922e884c414ff1b068af1da8f6 Jul 16 21:50:49.394267 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:49.394235 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f" event={"ID":"8dc6907a-8be0-4251-bada-6e89c4c81ef8","Type":"ContainerStarted","Data":"10432034d2a93c4a642e10a4a34150d3c2c5eb922e884c414ff1b068af1da8f6"} Jul 16 21:50:49.398323 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:49.398285 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-68xvq" event={"ID":"f11aa9c9-ff28-4085-b6ed-2fa149846ee7","Type":"ContainerStarted","Data":"e03956c777af25a12a75e1ff774df910de59976eeaa58fdde4d5016c6924797d"} Jul 16 21:50:49.401111 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:49.401081 2580 generic.go:356] "Generic (PLEG): container finished" podID="0b2139b2-a6a2-4bd1-81df-140cb9725bec" containerID="e3e6185414600dc2128596005156aed62441d88fbd23d648070372c43c16d98a" exitCode=0 Jul 16 21:50:49.401238 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:49.401124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" event={"ID":"0b2139b2-a6a2-4bd1-81df-140cb9725bec","Type":"ContainerDied","Data":"e3e6185414600dc2128596005156aed62441d88fbd23d648070372c43c16d98a"} Jul 16 21:50:50.407179 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:50.407134 2580 generic.go:356] "Generic (PLEG): container finished" podID="0b2139b2-a6a2-4bd1-81df-140cb9725bec" containerID="6f1d0e11459a360cfbf4bffd7686db21a6e6bc24d417b5a9edb52b892a287a2d" exitCode=0 Jul 16 21:50:50.407686 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:50.407213 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" event={"ID":"0b2139b2-a6a2-4bd1-81df-140cb9725bec","Type":"ContainerDied","Data":"6f1d0e11459a360cfbf4bffd7686db21a6e6bc24d417b5a9edb52b892a287a2d"} Jul 16 21:50:50.880939 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:50.880899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:50.881094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:50.880960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:50.881094 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:50.881045 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:50.881094 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:50.881083 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:50.881094 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:50.881094 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt: secret "image-registry-tls" not found Jul 16 21:50:50.881226 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:50.881109 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls podName:697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:54.881094534 +0000 UTC m=+43.182462818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls") pod "dns-default-rssrk" (UID: "697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c") : secret "dns-default-metrics-tls" not found Jul 16 21:50:50.881226 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:50.881128 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls podName:550b8482-d6ca-4f12-a727-e867f6f2ac9d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:54.88111834 +0000 UTC m=+43.182486622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls") pod "image-registry-6b7c6b9fd5-lmsxt" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d") : secret "image-registry-tls" not found Jul 16 21:50:51.412507 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.412295 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" event={"ID":"0b2139b2-a6a2-4bd1-81df-140cb9725bec","Type":"ContainerStarted","Data":"97b4cd1f3df7f9a1a8ed87b2383f82dc8ff624c5e8d7ddc3b9b93c7e074a49cc"} Jul 16 21:50:51.414020 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.413991 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f" event={"ID":"8dc6907a-8be0-4251-bada-6e89c4c81ef8","Type":"ContainerStarted","Data":"da03c9149cae74054052a7f6bcb4998be9d6d45710a7ba5b7c2408cc78a00ad5"} Jul 16 21:50:51.414133 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.414032 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f" event={"ID":"8dc6907a-8be0-4251-bada-6e89c4c81ef8","Type":"ContainerStarted","Data":"ddec6cc9ad5e1c91110d15c1372f43a7098c4e27003962f2b78dc7367e265c23"} Jul 16 21:50:51.415348 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.415325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-68xvq" event={"ID":"f11aa9c9-ff28-4085-b6ed-2fa149846ee7","Type":"ContainerStarted","Data":"24c2f4a19089c20908096a1e4d675eccf75a894e79bfaed94ee39eee0d7c2b99"} Jul 16 21:50:51.441406 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.441347 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hqsp4" podStartSLOduration=9.400359704 podStartE2EDuration="38.441322768s" totalImagesPullingTime="29.040963064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:51.439381027 +0000 UTC m=+39.740749331" watchObservedRunningTime="2026-07-16 21:50:51.441322768 +0000 UTC m=+39.742691073" Jul 16 21:50:51.457586 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.457537 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-68xvq" podStartSLOduration=1.691211663 podStartE2EDuration="4.457520722s" totalImagesPullingTime="2.766309059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:51.457146778 +0000 UTC m=+39.758515082" watchObservedRunningTime="2026-07-16 21:50:51.457520722 +0000 UTC m=+39.758889026" Jul 16 21:50:51.475792 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.475747 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4k7f" podStartSLOduration=1.311623282 podStartE2EDuration="3.475732612s" totalImagesPullingTime="2.16410933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:51.475165283 +0000 UTC m=+39.776533586" watchObservedRunningTime="2026-07-16 21:50:51.475732612 +0000 UTC m=+39.777100916" Jul 16 21:50:51.693959 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.693885 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dmh8v"] Jul 16 21:50:51.714632 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.714604 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dmh8v"] Jul 16 21:50:51.714778 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.714740 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.717858 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.717841 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 21:50:51.718369 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.718349 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 21:50:51.718532 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.718514 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 21:50:51.718603 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.718562 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s89fr\"" Jul 16 21:50:51.718603 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.718591 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 21:50:51.792759 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.792729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcx92\" (UniqueName: \"kubernetes.io/projected/f80f4253-98c1-4664-8ea2-174537979a2d-kube-api-access-wcx92\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.792878 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.792774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f80f4253-98c1-4664-8ea2-174537979a2d-crio-socket\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.792878 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.792794 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f80f4253-98c1-4664-8ea2-174537979a2d-data-volume\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.792878 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.792809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.792878 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.792826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.893892 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.893868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcx92\" (UniqueName: \"kubernetes.io/projected/f80f4253-98c1-4664-8ea2-174537979a2d-kube-api-access-wcx92\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.893978 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.893908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f80f4253-98c1-4664-8ea2-174537979a2d-crio-socket\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.893978 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.893923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f80f4253-98c1-4664-8ea2-174537979a2d-data-volume\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.893978 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.893940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.894119 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:51.894001 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:51.894119 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:51.894058 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:52.394041289 +0000 UTC m=+40.695409598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : configmap "kube-rbac-proxy" not found Jul 16 21:50:51.894119 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.894055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.894262 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:51.894150 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:51.894262 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.894156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f80f4253-98c1-4664-8ea2-174537979a2d-crio-socket\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.894262 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:51.894192 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:52.394181179 +0000 UTC m=+40.695549462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : secret "insights-runtime-extractor-tls" not found Jul 16 21:50:51.894262 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.894203 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f80f4253-98c1-4664-8ea2-174537979a2d-data-volume\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:51.904246 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:51.904220 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcx92\" (UniqueName: \"kubernetes.io/projected/f80f4253-98c1-4664-8ea2-174537979a2d-kube-api-access-wcx92\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:52.397641 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:52.397607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:52.397641 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:52.397641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:52.397885 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:52.397748 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:52.397885 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:52.397760 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:52.397885 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:52.397809 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:53.397796061 +0000 UTC m=+41.699164343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : secret "insights-runtime-extractor-tls" not found Jul 16 21:50:52.397885 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:52.397853 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:53.39784536 +0000 UTC m=+41.699213643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : configmap "kube-rbac-proxy" not found Jul 16 21:50:53.405215 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:53.405187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:53.405215 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:53.405217 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:53.405706 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:53.405304 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:53.405706 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:53.405376 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:55.40535495 +0000 UTC m=+43.706723446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : configmap "kube-rbac-proxy" not found Jul 16 21:50:53.405706 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:53.405389 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:53.405706 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:53.405438 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:55.40542589 +0000 UTC m=+43.706794191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : secret "insights-runtime-extractor-tls" not found Jul 16 21:50:53.538858 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:53.538832 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7rfmd_21833623-82fa-42d0-9f6f-24fc6fd8a79b/dns-node-resolver/0.log" Jul 16 21:50:54.736291 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:54.736265 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8zcdj_18f81724-7fd6-40fd-a874-deae8fac08b0/node-ca/0.log" Jul 16 21:50:54.915978 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:54.915950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:50:54.916102 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:54.915988 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:50:54.916102 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:54.916085 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:54.916102 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:54.916086 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:54.916193 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:54.916144 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls podName:697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c nodeName:}" failed. No retries permitted until 2026-07-16 21:51:02.916130349 +0000 UTC m=+51.217498634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls") pod "dns-default-rssrk" (UID: "697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c") : secret "dns-default-metrics-tls" not found Jul 16 21:50:54.916193 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:54.916094 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt: secret "image-registry-tls" not found Jul 16 21:50:54.916259 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:54.916213 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls podName:550b8482-d6ca-4f12-a727-e867f6f2ac9d nodeName:}" failed. No retries permitted until 2026-07-16 21:51:02.916203364 +0000 UTC m=+51.217571649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls") pod "image-registry-6b7c6b9fd5-lmsxt" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d") : secret "image-registry-tls" not found Jul 16 21:50:55.339708 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:55.339653 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-68xvq_f11aa9c9-ff28-4085-b6ed-2fa149846ee7/serve-healthcheck-canary/0.log" Jul 16 21:50:55.420410 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:55.420373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:55.420410 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:55.420410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:55.420595 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:55.420494 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:55.420595 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:55.420514 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:55.420595 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:55.420553 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:59.420541318 +0000 UTC m=+47.721909600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : secret "insights-runtime-extractor-tls" not found Jul 16 21:50:55.420595 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:55.420566 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:50:59.420558925 +0000 UTC m=+47.721927207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : configmap "kube-rbac-proxy" not found Jul 16 21:50:59.450471 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:59.450440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:59.450471 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:50:59.450477 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:50:59.451011 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:59.450557 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:50:59.451011 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:59.450619 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:51:07.450604746 +0000 UTC m=+55.751973028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : configmap "kube-rbac-proxy" not found Jul 16 21:50:59.451011 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:59.450686 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:50:59.451011 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:50:59.450747 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:51:07.450735811 +0000 UTC m=+55.752104094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : secret "insights-runtime-extractor-tls" not found Jul 16 21:51:02.974657 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:02.974612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:51:02.975060 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:02.974665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:51:02.975060 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:51:02.974779 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:51:02.975060 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:51:02.974844 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls podName:697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c nodeName:}" failed. No retries permitted until 2026-07-16 21:51:18.974828516 +0000 UTC m=+67.276196798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls") pod "dns-default-rssrk" (UID: "697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c") : secret "dns-default-metrics-tls" not found Jul 16 21:51:02.977016 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:02.977000 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") pod \"image-registry-6b7c6b9fd5-lmsxt\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:51:02.987198 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:02.987179 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:51:03.143158 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:03.143080 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt"] Jul 16 21:51:03.148047 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:03.148022 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550b8482_d6ca_4f12_a727_e867f6f2ac9d.slice/crio-b228ecbf14cf819612fac2ca2c729972d678281cc9c1eec41fa4675efb27a2c9 WatchSource:0}: Error finding container b228ecbf14cf819612fac2ca2c729972d678281cc9c1eec41fa4675efb27a2c9: Status 404 returned error can't find the container with id b228ecbf14cf819612fac2ca2c729972d678281cc9c1eec41fa4675efb27a2c9 Jul 16 21:51:03.444351 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:03.444316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" event={"ID":"550b8482-d6ca-4f12-a727-e867f6f2ac9d","Type":"ContainerStarted","Data":"a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7"} Jul 16 21:51:03.444525 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:03.444426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" event={"ID":"550b8482-d6ca-4f12-a727-e867f6f2ac9d","Type":"ContainerStarted","Data":"b228ecbf14cf819612fac2ca2c729972d678281cc9c1eec41fa4675efb27a2c9"} Jul 16 21:51:03.444525 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:03.444457 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:51:03.470536 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:03.470485 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" podStartSLOduration=20.470469779 podStartE2EDuration="20.470469779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:03.469816261 +0000 UTC m=+51.771184564" watchObservedRunningTime="2026-07-16 21:51:03.470469779 +0000 UTC m=+51.771838083" Jul 16 21:51:07.510686 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:07.510654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:51:07.510686 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:07.510689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:51:07.511175 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:51:07.510840 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:51:07.511175 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:51:07.510898 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls podName:f80f4253-98c1-4664-8ea2-174537979a2d nodeName:}" failed. No retries permitted until 2026-07-16 21:51:23.510884773 +0000 UTC m=+71.812253055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dmh8v" (UID: "f80f4253-98c1-4664-8ea2-174537979a2d") : secret "insights-runtime-extractor-tls" not found Jul 16 21:51:07.511250 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:07.511208 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f80f4253-98c1-4664-8ea2-174537979a2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:51:13.406170 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:13.406138 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-24qjh" Jul 16 21:51:17.879889 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:17.879856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:51:17.882887 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:17.882866 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 21:51:17.892230 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:17.892204 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e4b8d92-3a02-482d-bc1f-61e537dd7409-metrics-certs\") pod \"network-metrics-daemon-46cth\" (UID: \"7e4b8d92-3a02-482d-bc1f-61e537dd7409\") " pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:51:17.980949 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:17.980914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:51:17.981045 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:17.981005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:51:17.999458 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:17.999431 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 21:51:17.999838 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:17.999468 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 21:51:18.004590 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.004563 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98445a28-5caa-4485-9a1f-a0c7ee0ae943-original-pull-secret\") pod \"global-pull-secret-syncer-5s4f7\" (UID: \"98445a28-5caa-4485-9a1f-a0c7ee0ae943\") " pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:51:18.005496 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.005481 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 21:51:18.014938 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.014920 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv66w\" (UniqueName: \"kubernetes.io/projected/04e0efc9-aef4-409d-b03c-d67ea93a95ad-kube-api-access-tv66w\") pod \"network-check-target-dqmwr\" (UID: \"04e0efc9-aef4-409d-b03c-d67ea93a95ad\") " pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:51:18.142654 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.142568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5s4f7" Jul 16 21:51:18.153198 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.153159 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5fdwm\"" Jul 16 21:51:18.157741 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.157700 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wslpm\"" Jul 16 21:51:18.160857 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.160843 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-46cth" Jul 16 21:51:18.166054 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.166036 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:51:18.285814 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.285788 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5s4f7"] Jul 16 21:51:18.287325 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:18.287295 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98445a28_5caa_4485_9a1f_a0c7ee0ae943.slice/crio-a71b389520566d44bc9fb19c58429c3cea7503d4106ac2be037fead2cedb624f WatchSource:0}: Error finding container a71b389520566d44bc9fb19c58429c3cea7503d4106ac2be037fead2cedb624f: Status 404 returned error can't find the container with id a71b389520566d44bc9fb19c58429c3cea7503d4106ac2be037fead2cedb624f Jul 16 21:51:18.307657 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.307635 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqmwr"] Jul 16 21:51:18.309201 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:18.309177 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e0efc9_aef4_409d_b03c_d67ea93a95ad.slice/crio-a40c3d25ffadbabb9ff5db48f5c4f8228d2640a22065b2f7598b97ecd42a0d60 WatchSource:0}: Error finding container a40c3d25ffadbabb9ff5db48f5c4f8228d2640a22065b2f7598b97ecd42a0d60: Status 404 returned error can't find the container with id a40c3d25ffadbabb9ff5db48f5c4f8228d2640a22065b2f7598b97ecd42a0d60 Jul 16 21:51:18.326266 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.326245 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-46cth"] Jul 16 21:51:18.328474 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:18.328452 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4b8d92_3a02_482d_bc1f_61e537dd7409.slice/crio-844d9fa4ce314374b9842597552b9ca9c7bf1a67a152897d31d5c614705517e9 WatchSource:0}: Error finding container 844d9fa4ce314374b9842597552b9ca9c7bf1a67a152897d31d5c614705517e9: Status 404 returned error can't find the container with id 844d9fa4ce314374b9842597552b9ca9c7bf1a67a152897d31d5c614705517e9 Jul 16 21:51:18.480174 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.480142 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqmwr" event={"ID":"04e0efc9-aef4-409d-b03c-d67ea93a95ad","Type":"ContainerStarted","Data":"a40c3d25ffadbabb9ff5db48f5c4f8228d2640a22065b2f7598b97ecd42a0d60"} Jul 16 21:51:18.481359 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.481334 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-46cth" event={"ID":"7e4b8d92-3a02-482d-bc1f-61e537dd7409","Type":"ContainerStarted","Data":"844d9fa4ce314374b9842597552b9ca9c7bf1a67a152897d31d5c614705517e9"} Jul 16 21:51:18.482502 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.482476 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5s4f7" event={"ID":"98445a28-5caa-4485-9a1f-a0c7ee0ae943","Type":"ContainerStarted","Data":"a71b389520566d44bc9fb19c58429c3cea7503d4106ac2be037fead2cedb624f"} Jul 16 21:51:18.990401 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.990364 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:51:18.993220 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:18.993190 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c-metrics-tls\") pod \"dns-default-rssrk\" (UID: \"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c\") " pod="openshift-dns/dns-default-rssrk" Jul 16 21:51:19.232518 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:19.232489 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4vmw\"" Jul 16 21:51:19.239984 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:19.239960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rssrk" Jul 16 21:51:19.735110 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:19.735076 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rssrk"] Jul 16 21:51:19.903951 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:19.903859 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697f9fb7_fcfb_4f6d_9b57_c38d3bd8d36c.slice/crio-0ce6f1e7dcbc6ffd5333a6e59027e96c0d2ed785613bed81a182948aea42fbc0 WatchSource:0}: Error finding container 0ce6f1e7dcbc6ffd5333a6e59027e96c0d2ed785613bed81a182948aea42fbc0: Status 404 returned error can't find the container with id 0ce6f1e7dcbc6ffd5333a6e59027e96c0d2ed785613bed81a182948aea42fbc0 Jul 16 21:51:20.492683 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:20.492390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-46cth" event={"ID":"7e4b8d92-3a02-482d-bc1f-61e537dd7409","Type":"ContainerStarted","Data":"5253cc1f60cf4a26e2ebdea87eb49d23936af80c0ec9e4a4e4b8ba4a38e72865"} Jul 16 21:51:20.492683 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:20.492456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-46cth" event={"ID":"7e4b8d92-3a02-482d-bc1f-61e537dd7409","Type":"ContainerStarted","Data":"138c1d8d57c813420a7610f07266cbc5c048a5014918d16f2aaf4f8646c3e03d"} Jul 16 21:51:20.493605 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:20.493580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rssrk" event={"ID":"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c","Type":"ContainerStarted","Data":"0ce6f1e7dcbc6ffd5333a6e59027e96c0d2ed785613bed81a182948aea42fbc0"} Jul 16 21:51:20.520397 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:20.520340 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-46cth" podStartSLOduration=65.920890837 podStartE2EDuration="1m7.520321887s" totalImagesPullingTime="1.59943105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:20.517049865 +0000 UTC m=+68.818418170" watchObservedRunningTime="2026-07-16 21:51:20.520321887 +0000 UTC m=+68.821690190" Jul 16 21:51:22.992208 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:22.992175 2580 patch_prober.go:28] interesting pod/image-registry-6b7c6b9fd5-lmsxt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 21:51:22.992546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:22.992232 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" podUID="550b8482-d6ca-4f12-a727-e867f6f2ac9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 21:51:23.530928 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:23.530897 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:51:23.533319 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:23.533298 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f80f4253-98c1-4664-8ea2-174537979a2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dmh8v\" (UID: \"f80f4253-98c1-4664-8ea2-174537979a2d\") " pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:51:23.825633 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:23.825605 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s89fr\"" Jul 16 21:51:23.833219 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:23.833200 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dmh8v" Jul 16 21:51:23.959620 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:23.959518 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dmh8v"] Jul 16 21:51:23.961990 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:23.961968 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80f4253_98c1_4664_8ea2_174537979a2d.slice/crio-65e517c37bea075f5b496fb5b8e62a78a34a4ea2d818f38120383696c55aa2b0 WatchSource:0}: Error finding container 65e517c37bea075f5b496fb5b8e62a78a34a4ea2d818f38120383696c55aa2b0: Status 404 returned error can't find the container with id 65e517c37bea075f5b496fb5b8e62a78a34a4ea2d818f38120383696c55aa2b0 Jul 16 21:51:24.450552 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.450516 2580 patch_prober.go:28] interesting pod/image-registry-6b7c6b9fd5-lmsxt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 21:51:24.450929 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.450563 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" podUID="550b8482-d6ca-4f12-a727-e867f6f2ac9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 21:51:24.508884 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.508849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqmwr" event={"ID":"04e0efc9-aef4-409d-b03c-d67ea93a95ad","Type":"ContainerStarted","Data":"b60e743f89e67a52d216efe3daa269fcc747833af45c2322bed1dc2f69571929"} Jul 16 21:51:24.509015 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.508982 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:51:24.510617 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.510544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5s4f7" event={"ID":"98445a28-5caa-4485-9a1f-a0c7ee0ae943","Type":"ContainerStarted","Data":"08991489b4c36325fb18b824b119c76ec75699d3e364d4fdb8a817777cae9e00"} Jul 16 21:51:24.511872 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.511849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dmh8v" event={"ID":"f80f4253-98c1-4664-8ea2-174537979a2d","Type":"ContainerStarted","Data":"65e517c37bea075f5b496fb5b8e62a78a34a4ea2d818f38120383696c55aa2b0"} Jul 16 21:51:24.516481 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.513771 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rssrk" event={"ID":"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c","Type":"ContainerStarted","Data":"4b7b23ef8f95e4eb7b7cc3073f0743b1d0873205fc82c5144ea335305e9813f2"} Jul 16 21:51:24.516481 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.513861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rssrk" event={"ID":"697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c","Type":"ContainerStarted","Data":"c78484857d0ec2063a6a6a1c555293b36b6f4b520e7fefef54562d04684e7ded"} Jul 16 21:51:24.516481 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.514055 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rssrk" Jul 16 21:51:24.529117 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.529077 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dqmwr" podStartSLOduration=66.404541753 podStartE2EDuration="1m11.529066782s" totalImagesPullingTime="5.124525029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:24.527753425 +0000 UTC m=+72.829121728" watchObservedRunningTime="2026-07-16 21:51:24.529066782 +0000 UTC m=+72.830435086" Jul 16 21:51:24.569404 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:24.569349 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5s4f7" podStartSLOduration=66.401866599 podStartE2EDuration="1m11.56933654s" totalImagesPullingTime="5.167469941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:24.546383714 +0000 UTC m=+72.847752020" watchObservedRunningTime="2026-07-16 21:51:24.56933654 +0000 UTC m=+72.870704843" Jul 16 21:51:25.034966 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.034907 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rssrk" podStartSLOduration=34.497879037 podStartE2EDuration="38.03488621s" totalImagesPullingTime="3.537007173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:24.568765928 +0000 UTC m=+72.870134234" watchObservedRunningTime="2026-07-16 21:51:25.03488621 +0000 UTC m=+73.336254564" Jul 16 21:51:25.035444 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.035421 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v"] Jul 16 21:51:25.037552 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.037532 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.042178 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.042159 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 21:51:25.043480 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.043452 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 16 21:51:25.043583 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.043493 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 21:51:25.043583 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.043494 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 21:51:25.060008 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.059953 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v"] Jul 16 21:51:25.142045 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.142015 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/52fb442d-be0c-42cb-9412-0a1621154ce8-klusterlet-config\") pod \"klusterlet-addon-workmgr-6889c788c-fbr9v\" (UID: \"52fb442d-be0c-42cb-9412-0a1621154ce8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.142198 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.142065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp7tj\" (UniqueName: \"kubernetes.io/projected/52fb442d-be0c-42cb-9412-0a1621154ce8-kube-api-access-zp7tj\") pod \"klusterlet-addon-workmgr-6889c788c-fbr9v\" (UID: \"52fb442d-be0c-42cb-9412-0a1621154ce8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.142198 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.142126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52fb442d-be0c-42cb-9412-0a1621154ce8-tmp\") pod \"klusterlet-addon-workmgr-6889c788c-fbr9v\" (UID: \"52fb442d-be0c-42cb-9412-0a1621154ce8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.151680 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.151511 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5"] Jul 16 21:51:25.153784 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.153759 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" Jul 16 21:51:25.161539 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.161519 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 16 21:51:25.162397 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.162380 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z98hd\"" Jul 16 21:51:25.162634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.162620 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 16 21:51:25.182997 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.182972 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp"] Jul 16 21:51:25.185025 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.185006 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt"] Jul 16 21:51:25.185138 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.185049 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5"] Jul 16 21:51:25.185138 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.185132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" Jul 16 21:51:25.189835 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.189811 2580 patch_prober.go:28] interesting pod/image-registry-6b7c6b9fd5-lmsxt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 21:51:25.189966 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.189886 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" podUID="550b8482-d6ca-4f12-a727-e867f6f2ac9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 21:51:25.191294 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.191157 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 21:51:25.191294 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.191158 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mbn4w\"" Jul 16 21:51:25.221434 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.221415 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp"] Jul 16 21:51:25.242747 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.242700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp7tj\" (UniqueName: \"kubernetes.io/projected/52fb442d-be0c-42cb-9412-0a1621154ce8-kube-api-access-zp7tj\") pod \"klusterlet-addon-workmgr-6889c788c-fbr9v\" (UID: \"52fb442d-be0c-42cb-9412-0a1621154ce8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.242861 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.242778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52fb442d-be0c-42cb-9412-0a1621154ce8-tmp\") pod \"klusterlet-addon-workmgr-6889c788c-fbr9v\" (UID: \"52fb442d-be0c-42cb-9412-0a1621154ce8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.242861 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.242810 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a8122a2-f750-4448-be0c-be9421edbba2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-gx9kp\" (UID: \"2a8122a2-f750-4448-be0c-be9421edbba2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" Jul 16 21:51:25.242861 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.242834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9bd91568-aff6-4ce0-b8af-e81ab9688148-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-tndd5\" (UID: \"9bd91568-aff6-4ce0-b8af-e81ab9688148\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" Jul 16 21:51:25.243013 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.242860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bd91568-aff6-4ce0-b8af-e81ab9688148-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tndd5\" (UID: \"9bd91568-aff6-4ce0-b8af-e81ab9688148\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" Jul 16 21:51:25.243013 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.242941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/52fb442d-be0c-42cb-9412-0a1621154ce8-klusterlet-config\") pod \"klusterlet-addon-workmgr-6889c788c-fbr9v\" (UID: \"52fb442d-be0c-42cb-9412-0a1621154ce8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.243180 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.243160 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52fb442d-be0c-42cb-9412-0a1621154ce8-tmp\") pod \"klusterlet-addon-workmgr-6889c788c-fbr9v\" (UID: \"52fb442d-be0c-42cb-9412-0a1621154ce8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.245636 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.245616 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/52fb442d-be0c-42cb-9412-0a1621154ce8-klusterlet-config\") pod \"klusterlet-addon-workmgr-6889c788c-fbr9v\" (UID: \"52fb442d-be0c-42cb-9412-0a1621154ce8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.279992 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.279961 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp7tj\" (UniqueName: \"kubernetes.io/projected/52fb442d-be0c-42cb-9412-0a1621154ce8-kube-api-access-zp7tj\") pod \"klusterlet-addon-workmgr-6889c788c-fbr9v\" (UID: \"52fb442d-be0c-42cb-9412-0a1621154ce8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.287431 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.287350 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-knpdb"] Jul 16 21:51:25.289535 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.289519 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c465ff78-zdvtt"] Jul 16 21:51:25.289663 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.289644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-knpdb" Jul 16 21:51:25.291512 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.291492 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.292926 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.292890 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5tc22\"" Jul 16 21:51:25.292926 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.292911 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 21:51:25.293274 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.293221 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 21:51:25.294154 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.294108 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 21:51:25.294464 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.294399 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 21:51:25.294558 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.294539 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 21:51:25.294646 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.294604 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9hlmp\"" Jul 16 21:51:25.294698 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.294606 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 21:51:25.295037 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.295019 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 21:51:25.305294 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.305115 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 21:51:25.318693 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.318671 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-knpdb"] Jul 16 21:51:25.342292 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.342267 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c465ff78-zdvtt"] Jul 16 21:51:25.343200 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343143 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67b5dfb4-nrrfh"] Jul 16 21:51:25.343308 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrv5g\" (UniqueName: \"kubernetes.io/projected/5badf17d-5121-451a-97d9-39922c618279-kube-api-access-rrv5g\") pod \"downloads-5bc67dcd46-knpdb\" (UID: \"5badf17d-5121-451a-97d9-39922c618279\") " pod="openshift-console/downloads-5bc67dcd46-knpdb" Jul 16 21:51:25.343308 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bd91568-aff6-4ce0-b8af-e81ab9688148-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tndd5\" (UID: \"9bd91568-aff6-4ce0-b8af-e81ab9688148\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" Jul 16 21:51:25.343414 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343323 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a8122a2-f750-4448-be0c-be9421edbba2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-gx9kp\" (UID: \"2a8122a2-f750-4448-be0c-be9421edbba2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" Jul 16 21:51:25.343414 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9bd91568-aff6-4ce0-b8af-e81ab9688148-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-tndd5\" (UID: \"9bd91568-aff6-4ce0-b8af-e81ab9688148\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" Jul 16 21:51:25.343414 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343391 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-oauth-serving-cert\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.343930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-serving-cert\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.343930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343465 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-oauth-config\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.343930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-config\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.343930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-trusted-ca-bundle\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.343930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26wtl\" (UniqueName: \"kubernetes.io/projected/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-kube-api-access-26wtl\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.343930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.343599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-service-ca\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.344479 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.344436 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9bd91568-aff6-4ce0-b8af-e81ab9688148-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-tndd5\" (UID: \"9bd91568-aff6-4ce0-b8af-e81ab9688148\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" Jul 16 21:51:25.345483 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.345464 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.346897 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.346856 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a8122a2-f750-4448-be0c-be9421edbba2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-gx9kp\" (UID: \"2a8122a2-f750-4448-be0c-be9421edbba2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" Jul 16 21:51:25.346973 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.346900 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bd91568-aff6-4ce0-b8af-e81ab9688148-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tndd5\" (UID: \"9bd91568-aff6-4ce0-b8af-e81ab9688148\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" Jul 16 21:51:25.349099 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.349076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:25.367680 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.367652 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67b5dfb4-nrrfh"] Jul 16 21:51:25.444561 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.444214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-trusted-ca-bundle\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.444561 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.444254 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed9e0494-166d-4611-a2d7-243f9419b222-registry-tls\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.444561 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.444283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26wtl\" (UniqueName: \"kubernetes.io/projected/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-kube-api-access-26wtl\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.444561 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.444348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-service-ca\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.444561 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.444403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed9e0494-166d-4611-a2d7-243f9419b222-installation-pull-secrets\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.444561 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.444436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed9e0494-166d-4611-a2d7-243f9419b222-bound-sa-token\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.444561 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.444462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed9e0494-166d-4611-a2d7-243f9419b222-registry-certificates\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.444561 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.444502 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrv5g\" (UniqueName: \"kubernetes.io/projected/5badf17d-5121-451a-97d9-39922c618279-kube-api-access-rrv5g\") pod \"downloads-5bc67dcd46-knpdb\" (UID: \"5badf17d-5121-451a-97d9-39922c618279\") " pod="openshift-console/downloads-5bc67dcd46-knpdb" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445173 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-trusted-ca-bundle\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445300 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-service-ca\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc6h6\" (UniqueName: \"kubernetes.io/projected/ed9e0494-166d-4611-a2d7-243f9419b222-kube-api-access-nc6h6\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed9e0494-166d-4611-a2d7-243f9419b222-image-registry-private-configuration\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed9e0494-166d-4611-a2d7-243f9419b222-ca-trust-extracted\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-oauth-serving-cert\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-serving-cert\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed9e0494-166d-4611-a2d7-243f9419b222-trusted-ca\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-oauth-config\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.445754 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.445574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-config\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.446615 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.446597 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-config\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.446789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.446767 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-oauth-serving-cert\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.448958 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.448932 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-serving-cert\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.449268 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.449252 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-oauth-config\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.464187 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.464157 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" Jul 16 21:51:25.467994 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.467973 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26wtl\" (UniqueName: \"kubernetes.io/projected/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-kube-api-access-26wtl\") pod \"console-6c465ff78-zdvtt\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.468355 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.468332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrv5g\" (UniqueName: \"kubernetes.io/projected/5badf17d-5121-451a-97d9-39922c618279-kube-api-access-rrv5g\") pod \"downloads-5bc67dcd46-knpdb\" (UID: \"5badf17d-5121-451a-97d9-39922c618279\") " pod="openshift-console/downloads-5bc67dcd46-knpdb" Jul 16 21:51:25.494931 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.494907 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v"] Jul 16 21:51:25.496122 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.496096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" Jul 16 21:51:25.497993 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:25.497955 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fb442d_be0c_42cb_9412_0a1621154ce8.slice/crio-2ede49e55503b979f04a27c38c26262da8dae8402874d996b59060d28e76294c WatchSource:0}: Error finding container 2ede49e55503b979f04a27c38c26262da8dae8402874d996b59060d28e76294c: Status 404 returned error can't find the container with id 2ede49e55503b979f04a27c38c26262da8dae8402874d996b59060d28e76294c Jul 16 21:51:25.525697 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.525661 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" event={"ID":"52fb442d-be0c-42cb-9412-0a1621154ce8","Type":"ContainerStarted","Data":"2ede49e55503b979f04a27c38c26262da8dae8402874d996b59060d28e76294c"} Jul 16 21:51:25.546611 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.546534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed9e0494-166d-4611-a2d7-243f9419b222-registry-tls\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.546611 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.546591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed9e0494-166d-4611-a2d7-243f9419b222-installation-pull-secrets\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.546885 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.546615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed9e0494-166d-4611-a2d7-243f9419b222-bound-sa-token\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.546885 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.546830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed9e0494-166d-4611-a2d7-243f9419b222-registry-certificates\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.546995 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.546889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc6h6\" (UniqueName: \"kubernetes.io/projected/ed9e0494-166d-4611-a2d7-243f9419b222-kube-api-access-nc6h6\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.546995 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.546909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed9e0494-166d-4611-a2d7-243f9419b222-image-registry-private-configuration\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.546995 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.546926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed9e0494-166d-4611-a2d7-243f9419b222-ca-trust-extracted\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.546995 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.546956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed9e0494-166d-4611-a2d7-243f9419b222-trusted-ca\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.547729 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.547692 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed9e0494-166d-4611-a2d7-243f9419b222-registry-certificates\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.547980 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.547957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed9e0494-166d-4611-a2d7-243f9419b222-ca-trust-extracted\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.548923 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.548898 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed9e0494-166d-4611-a2d7-243f9419b222-trusted-ca\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.549701 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.549656 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed9e0494-166d-4611-a2d7-243f9419b222-registry-tls\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.549828 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.549767 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed9e0494-166d-4611-a2d7-243f9419b222-image-registry-private-configuration\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.550693 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.550651 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed9e0494-166d-4611-a2d7-243f9419b222-installation-pull-secrets\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.563113 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.563069 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed9e0494-166d-4611-a2d7-243f9419b222-bound-sa-token\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.570741 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.570699 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc6h6\" (UniqueName: \"kubernetes.io/projected/ed9e0494-166d-4611-a2d7-243f9419b222-kube-api-access-nc6h6\") pod \"image-registry-67b5dfb4-nrrfh\" (UID: \"ed9e0494-166d-4611-a2d7-243f9419b222\") " pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.602482 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.602427 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-knpdb" Jul 16 21:51:25.608183 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.607873 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:25.616622 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.616504 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5"] Jul 16 21:51:25.619945 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:25.619763 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd91568_aff6_4ce0_b8af_e81ab9688148.slice/crio-240693d19591717fddc3351a72aa71fd234ea7ef8511fc3899a04c9453a5e6ea WatchSource:0}: Error finding container 240693d19591717fddc3351a72aa71fd234ea7ef8511fc3899a04c9453a5e6ea: Status 404 returned error can't find the container with id 240693d19591717fddc3351a72aa71fd234ea7ef8511fc3899a04c9453a5e6ea Jul 16 21:51:25.668592 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.668552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:25.693383 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.692222 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp"] Jul 16 21:51:25.701266 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:25.701212 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8122a2_f750_4448_be0c_be9421edbba2.slice/crio-8a7ab7360b58ba095e7d914a03e82bdf861dfe22aa8577a14f96589a59fbbbc4 WatchSource:0}: Error finding container 8a7ab7360b58ba095e7d914a03e82bdf861dfe22aa8577a14f96589a59fbbbc4: Status 404 returned error can't find the container with id 8a7ab7360b58ba095e7d914a03e82bdf861dfe22aa8577a14f96589a59fbbbc4 Jul 16 21:51:25.799928 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.799799 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c465ff78-zdvtt"] Jul 16 21:51:25.804175 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:25.804143 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7680bc3_2e5b_46d5_b8c8_24507f4dedd7.slice/crio-83e180fdf757b816dbe4a4b23aadae54523dd6d74f7f5d5d21350ff51dc30172 WatchSource:0}: Error finding container 83e180fdf757b816dbe4a4b23aadae54523dd6d74f7f5d5d21350ff51dc30172: Status 404 returned error can't find the container with id 83e180fdf757b816dbe4a4b23aadae54523dd6d74f7f5d5d21350ff51dc30172 Jul 16 21:51:25.819763 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.819737 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-knpdb"] Jul 16 21:51:25.822604 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:25.822580 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5badf17d_5121_451a_97d9_39922c618279.slice/crio-ebf0bb88143067cdaf254d0eb38754fbe4dde286e049489041cde043eefa5683 WatchSource:0}: Error finding container ebf0bb88143067cdaf254d0eb38754fbe4dde286e049489041cde043eefa5683: Status 404 returned error can't find the container with id ebf0bb88143067cdaf254d0eb38754fbe4dde286e049489041cde043eefa5683 Jul 16 21:51:25.852811 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:25.852774 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67b5dfb4-nrrfh"] Jul 16 21:51:25.855243 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:25.855220 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9e0494_166d_4611_a2d7_243f9419b222.slice/crio-4281d9a26c0014fc661a43c210c5b01e720bad55f3160b652bc6abf911625c1f WatchSource:0}: Error finding container 4281d9a26c0014fc661a43c210c5b01e720bad55f3160b652bc6abf911625c1f: Status 404 returned error can't find the container with id 4281d9a26c0014fc661a43c210c5b01e720bad55f3160b652bc6abf911625c1f Jul 16 21:51:26.535454 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:26.535356 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-knpdb" event={"ID":"5badf17d-5121-451a-97d9-39922c618279","Type":"ContainerStarted","Data":"ebf0bb88143067cdaf254d0eb38754fbe4dde286e049489041cde043eefa5683"} Jul 16 21:51:26.539574 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:26.539270 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" event={"ID":"ed9e0494-166d-4611-a2d7-243f9419b222","Type":"ContainerStarted","Data":"27c04d1ec41a36bf35e0e84a7b4de287da41addc50399d6d3f8eb0e302e7b9f0"} Jul 16 21:51:26.539574 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:26.539321 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" event={"ID":"ed9e0494-166d-4611-a2d7-243f9419b222","Type":"ContainerStarted","Data":"4281d9a26c0014fc661a43c210c5b01e720bad55f3160b652bc6abf911625c1f"} Jul 16 21:51:26.539574 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:26.539368 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:26.541383 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:26.541352 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" event={"ID":"2a8122a2-f750-4448-be0c-be9421edbba2","Type":"ContainerStarted","Data":"8a7ab7360b58ba095e7d914a03e82bdf861dfe22aa8577a14f96589a59fbbbc4"} Jul 16 21:51:26.543339 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:26.543317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c465ff78-zdvtt" event={"ID":"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7","Type":"ContainerStarted","Data":"83e180fdf757b816dbe4a4b23aadae54523dd6d74f7f5d5d21350ff51dc30172"} Jul 16 21:51:26.545643 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:26.545616 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" event={"ID":"9bd91568-aff6-4ce0-b8af-e81ab9688148","Type":"ContainerStarted","Data":"240693d19591717fddc3351a72aa71fd234ea7ef8511fc3899a04c9453a5e6ea"} Jul 16 21:51:34.527923 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.527884 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rssrk" Jul 16 21:51:34.551184 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.551125 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" podStartSLOduration=9.55108881 podStartE2EDuration="9.55108881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:26.587050494 +0000 UTC m=+74.888418799" watchObservedRunningTime="2026-07-16 21:51:34.55108881 +0000 UTC m=+82.852457093" Jul 16 21:51:34.595490 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.595406 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dmh8v" event={"ID":"f80f4253-98c1-4664-8ea2-174537979a2d","Type":"ContainerStarted","Data":"2176025f449248c873dd055ea1cb431d21bea784cdf897b98058527ca6f157af"} Jul 16 21:51:34.597301 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.597270 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" event={"ID":"52fb442d-be0c-42cb-9412-0a1621154ce8","Type":"ContainerStarted","Data":"f3a078470711485c2e91d50b7c06294361554e838c90d023cc45420fb99be7ee"} Jul 16 21:51:34.597468 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.597450 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:34.599154 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.599131 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" Jul 16 21:51:34.599246 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.599170 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" event={"ID":"2a8122a2-f750-4448-be0c-be9421edbba2","Type":"ContainerStarted","Data":"645022bbcf871c70975d6333a4298245ee0e3d8720ae2bf085dbfb5f0e823da6"} Jul 16 21:51:34.599404 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.599384 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" Jul 16 21:51:34.601737 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.601660 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c465ff78-zdvtt" event={"ID":"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7","Type":"ContainerStarted","Data":"cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a"} Jul 16 21:51:34.603434 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.603411 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" event={"ID":"9bd91568-aff6-4ce0-b8af-e81ab9688148","Type":"ContainerStarted","Data":"0c54cace2c74cc70a74002396c479c5979e30564e55d74b28dd396bed6f28f18"} Jul 16 21:51:34.604654 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.604635 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" Jul 16 21:51:34.626695 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.626641 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6889c788c-fbr9v" podStartSLOduration=1.771286178 podStartE2EDuration="10.626628327s" totalImagesPullingTime="8.855342149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:34.625135823 +0000 UTC m=+82.926504139" watchObservedRunningTime="2026-07-16 21:51:34.626628327 +0000 UTC m=+82.927996631" Jul 16 21:51:34.682816 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.682756 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tndd5" podStartSLOduration=0.972477411 podStartE2EDuration="9.682735891s" totalImagesPullingTime="8.71025848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:34.682436337 +0000 UTC m=+82.983804642" watchObservedRunningTime="2026-07-16 21:51:34.682735891 +0000 UTC m=+82.984104195" Jul 16 21:51:34.710177 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.710123 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-gx9kp" podStartSLOduration=1.080493021 podStartE2EDuration="9.710107144s" totalImagesPullingTime="8.629614123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:34.709745541 +0000 UTC m=+83.011113849" watchObservedRunningTime="2026-07-16 21:51:34.710107144 +0000 UTC m=+83.011475450" Jul 16 21:51:34.744682 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:34.744631 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c465ff78-zdvtt" podStartSLOduration=1.218101616 podStartE2EDuration="9.74461088s" totalImagesPullingTime="8.526509264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:34.744508376 +0000 UTC m=+83.045876681" watchObservedRunningTime="2026-07-16 21:51:34.74461088 +0000 UTC m=+83.045979164" Jul 16 21:51:35.194363 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:35.194179 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:51:35.610790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:35.610656 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:35.610790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:35.610747 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:35.616517 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:35.616492 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:36.620948 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:36.620921 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:51:41.404178 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.404145 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq"] Jul 16 21:51:41.527093 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.527060 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq"] Jul 16 21:51:41.527260 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.527118 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6qljp"] Jul 16 21:51:41.527329 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.527271 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.530316 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.530290 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l49lw\"" Jul 16 21:51:41.530493 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.530470 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 21:51:41.531687 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.531664 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 21:51:41.531815 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.531799 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 16 21:51:41.532247 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.532228 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 16 21:51:41.532347 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.532289 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 21:51:41.543406 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.543389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.546135 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.546116 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bkh4j\"" Jul 16 21:51:41.546419 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.546398 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 21:51:41.546487 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.546403 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 21:51:41.546746 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.546731 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 21:51:41.687669 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x94pj\" (UniqueName: \"kubernetes.io/projected/ca67f2f9-44cc-4f01-81e1-79471f090ccb-kube-api-access-x94pj\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.687669 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3764158-af2a-420e-ba70-806a535c1635-sys\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.687881 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3764158-af2a-420e-ba70-806a535c1635-root\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.687881 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687747 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-wtmp\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.687881 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-textfile\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.687881 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca67f2f9-44cc-4f01-81e1-79471f090ccb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.687881 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-accelerators-collector-config\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.687881 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.688105 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9xpg\" (UniqueName: \"kubernetes.io/projected/e3764158-af2a-420e-ba70-806a535c1635-kube-api-access-d9xpg\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.688105 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.687929 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca67f2f9-44cc-4f01-81e1-79471f090ccb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.688105 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.688028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-tls\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.688105 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.688051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3764158-af2a-420e-ba70-806a535c1635-metrics-client-ca\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.688105 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.688077 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca67f2f9-44cc-4f01-81e1-79471f090ccb-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.789300 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9xpg\" (UniqueName: \"kubernetes.io/projected/e3764158-af2a-420e-ba70-806a535c1635-kube-api-access-d9xpg\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.789461 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca67f2f9-44cc-4f01-81e1-79471f090ccb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.789461 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-tls\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.789461 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789358 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3764158-af2a-420e-ba70-806a535c1635-metrics-client-ca\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.789461 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca67f2f9-44cc-4f01-81e1-79471f090ccb-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.789461 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x94pj\" (UniqueName: \"kubernetes.io/projected/ca67f2f9-44cc-4f01-81e1-79471f090ccb-kube-api-access-x94pj\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.789773 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3764158-af2a-420e-ba70-806a535c1635-sys\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.789773 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3764158-af2a-420e-ba70-806a535c1635-root\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.789773 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-wtmp\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.789773 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-textfile\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.789773 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3764158-af2a-420e-ba70-806a535c1635-sys\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.789773 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca67f2f9-44cc-4f01-81e1-79471f090ccb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.790059 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789781 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-accelerators-collector-config\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.790059 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.790059 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-wtmp\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.790059 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.789883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3764158-af2a-420e-ba70-806a535c1635-root\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.790267 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.790244 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3764158-af2a-420e-ba70-806a535c1635-metrics-client-ca\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.790323 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.790304 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca67f2f9-44cc-4f01-81e1-79471f090ccb-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.790390 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.790364 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-accelerators-collector-config\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.790567 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.790542 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-textfile\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.792235 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.792210 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.792527 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.792493 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca67f2f9-44cc-4f01-81e1-79471f090ccb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.792643 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.792502 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca67f2f9-44cc-4f01-81e1-79471f090ccb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.792643 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.792551 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3764158-af2a-420e-ba70-806a535c1635-node-exporter-tls\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.801484 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.801298 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x94pj\" (UniqueName: \"kubernetes.io/projected/ca67f2f9-44cc-4f01-81e1-79471f090ccb-kube-api-access-x94pj\") pod \"openshift-state-metrics-79f6958cdf-pfzjq\" (UID: \"ca67f2f9-44cc-4f01-81e1-79471f090ccb\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.802156 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.802134 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9xpg\" (UniqueName: \"kubernetes.io/projected/e3764158-af2a-420e-ba70-806a535c1635-kube-api-access-d9xpg\") pod \"node-exporter-6qljp\" (UID: \"e3764158-af2a-420e-ba70-806a535c1635\") " pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:41.838853 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.838831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" Jul 16 21:51:41.852963 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:41.852942 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6qljp" Jul 16 21:51:45.150207 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:45.150177 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3764158_af2a_420e_ba70_806a535c1635.slice/crio-8aad285476cdf60daf29706d6f7099d35af810f476e5ef35466ed7fec6c4fa48 WatchSource:0}: Error finding container 8aad285476cdf60daf29706d6f7099d35af810f476e5ef35466ed7fec6c4fa48: Status 404 returned error can't find the container with id 8aad285476cdf60daf29706d6f7099d35af810f476e5ef35466ed7fec6c4fa48 Jul 16 21:51:45.281314 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.281263 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq"] Jul 16 21:51:45.283896 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:45.283871 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca67f2f9_44cc_4f01_81e1_79471f090ccb.slice/crio-59ef7e65514727a8648bd9f358bcca81591440736e5110dfe2ce0e628cf0884a WatchSource:0}: Error finding container 59ef7e65514727a8648bd9f358bcca81591440736e5110dfe2ce0e628cf0884a: Status 404 returned error can't find the container with id 59ef7e65514727a8648bd9f358bcca81591440736e5110dfe2ce0e628cf0884a Jul 16 21:51:45.653407 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.653337 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dmh8v" event={"ID":"f80f4253-98c1-4664-8ea2-174537979a2d","Type":"ContainerStarted","Data":"cc8c682dbdcc5ccd6b449b6170f5e6ae0ec1fda2fd29098db7335d5d9422b5c3"} Jul 16 21:51:45.656663 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.655999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-knpdb" event={"ID":"5badf17d-5121-451a-97d9-39922c618279","Type":"ContainerStarted","Data":"cec931fdb36166a033f3b2968881d50d0448cd198bc52e339f80f3331fc4a40e"} Jul 16 21:51:45.656663 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.656647 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-knpdb" Jul 16 21:51:45.659693 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.659567 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" event={"ID":"ca67f2f9-44cc-4f01-81e1-79471f090ccb","Type":"ContainerStarted","Data":"0f8b7391cc29e48f046b9cbb49c309ad0fb9de8cd4069066773c11135c32d309"} Jul 16 21:51:45.659693 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.659623 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" event={"ID":"ca67f2f9-44cc-4f01-81e1-79471f090ccb","Type":"ContainerStarted","Data":"0a658de71d27b2bcad4ac91219be2b879a380102d74c39ed1e0d7763c4f2ca91"} Jul 16 21:51:45.659693 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.659648 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" event={"ID":"ca67f2f9-44cc-4f01-81e1-79471f090ccb","Type":"ContainerStarted","Data":"59ef7e65514727a8648bd9f358bcca81591440736e5110dfe2ce0e628cf0884a"} Jul 16 21:51:45.661248 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.661200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qljp" event={"ID":"e3764158-af2a-420e-ba70-806a535c1635","Type":"ContainerStarted","Data":"8aad285476cdf60daf29706d6f7099d35af810f476e5ef35466ed7fec6c4fa48"} Jul 16 21:51:45.666534 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.666505 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-knpdb" Jul 16 21:51:45.680598 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.680376 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-knpdb" podStartSLOduration=1.309900794 podStartE2EDuration="20.680360348s" totalImagesPullingTime="19.370459554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:45.679444836 +0000 UTC m=+93.980813144" watchObservedRunningTime="2026-07-16 21:51:45.680360348 +0000 UTC m=+93.981728652" Jul 16 21:51:45.971699 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.970259 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9cc6d59b9-snrdr"] Jul 16 21:51:45.997255 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:45.997226 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.002839 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.001603 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 21:51:46.002839 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.002091 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 21:51:46.002839 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.002300 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 21:51:46.002839 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.002342 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9cc6d59b9-snrdr"] Jul 16 21:51:46.002839 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.002489 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 21:51:46.002839 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.002677 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cfmgi76ih6tnh\"" Jul 16 21:51:46.004537 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.004043 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pwm7b\"" Jul 16 21:51:46.123334 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.123303 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-599dfbdcd9-9h8p6"] Jul 16 21:51:46.126041 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.126011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c3804c34-53a9-41d4-8814-41ac6123fc45-metrics-server-audit-profiles\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.126166 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.126052 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c3804c34-53a9-41d4-8814-41ac6123fc45-secret-metrics-server-tls\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.126166 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.126096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3804c34-53a9-41d4-8814-41ac6123fc45-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.126278 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.126164 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcrkt\" (UniqueName: \"kubernetes.io/projected/c3804c34-53a9-41d4-8814-41ac6123fc45-kube-api-access-bcrkt\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.126278 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.126222 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c3804c34-53a9-41d4-8814-41ac6123fc45-audit-log\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.126375 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.126295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c3804c34-53a9-41d4-8814-41ac6123fc45-secret-metrics-server-client-certs\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.126375 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.126320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3804c34-53a9-41d4-8814-41ac6123fc45-client-ca-bundle\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.145979 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.145951 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.170704 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.170670 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599dfbdcd9-9h8p6"] Jul 16 21:51:46.227343 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.227266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3804c34-53a9-41d4-8814-41ac6123fc45-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.227343 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.227329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcrkt\" (UniqueName: \"kubernetes.io/projected/c3804c34-53a9-41d4-8814-41ac6123fc45-kube-api-access-bcrkt\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.227579 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.227371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c3804c34-53a9-41d4-8814-41ac6123fc45-audit-log\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.227579 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.227429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c3804c34-53a9-41d4-8814-41ac6123fc45-secret-metrics-server-client-certs\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.227579 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.227452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3804c34-53a9-41d4-8814-41ac6123fc45-client-ca-bundle\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.227579 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.227482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c3804c34-53a9-41d4-8814-41ac6123fc45-metrics-server-audit-profiles\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.227809 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.227776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c3804c34-53a9-41d4-8814-41ac6123fc45-secret-metrics-server-tls\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.227998 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.227967 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c3804c34-53a9-41d4-8814-41ac6123fc45-audit-log\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.228201 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.228176 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3804c34-53a9-41d4-8814-41ac6123fc45-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.228500 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.228478 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c3804c34-53a9-41d4-8814-41ac6123fc45-metrics-server-audit-profiles\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.230804 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.230754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c3804c34-53a9-41d4-8814-41ac6123fc45-secret-metrics-server-client-certs\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.230911 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.230897 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3804c34-53a9-41d4-8814-41ac6123fc45-client-ca-bundle\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.231382 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.231358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c3804c34-53a9-41d4-8814-41ac6123fc45-secret-metrics-server-tls\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.251120 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.251091 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcrkt\" (UniqueName: \"kubernetes.io/projected/c3804c34-53a9-41d4-8814-41ac6123fc45-kube-api-access-bcrkt\") pod \"metrics-server-9cc6d59b9-snrdr\" (UID: \"c3804c34-53a9-41d4-8814-41ac6123fc45\") " pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.312693 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.312653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:51:46.328967 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.328937 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-trusted-ca-bundle\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.329073 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.328995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-config\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.329144 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.329067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-service-ca\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.329214 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.329190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-serving-cert\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.329269 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.329237 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-oauth-serving-cert\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.329319 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.329270 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-oauth-config\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.329319 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.329293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgjbw\" (UniqueName: \"kubernetes.io/projected/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-kube-api-access-qgjbw\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.432487 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.432431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-serving-cert\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.432487 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.432478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-oauth-serving-cert\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.432741 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.432509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-oauth-config\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.432741 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.432533 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgjbw\" (UniqueName: \"kubernetes.io/projected/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-kube-api-access-qgjbw\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.432741 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.432577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-trusted-ca-bundle\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.432741 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.432631 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-config\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.432741 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.432652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-service-ca\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.434248 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.434217 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-trusted-ca-bundle\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.434357 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.434289 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-config\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.434751 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.434521 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-oauth-serving-cert\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.435445 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.435401 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-service-ca\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.439660 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.439611 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-oauth-config\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.442965 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.441703 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-serving-cert\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.446886 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.446860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgjbw\" (UniqueName: \"kubernetes.io/projected/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-kube-api-access-qgjbw\") pod \"console-599dfbdcd9-9h8p6\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.464312 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.463920 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:46.503237 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.502766 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9cc6d59b9-snrdr"] Jul 16 21:51:46.536904 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:46.536817 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3804c34_53a9_41d4_8814_41ac6123fc45.slice/crio-eeffa50c48b28c4395acbe66462d129370544d5be2bb7e764680b7da2eadc02f WatchSource:0}: Error finding container eeffa50c48b28c4395acbe66462d129370544d5be2bb7e764680b7da2eadc02f: Status 404 returned error can't find the container with id eeffa50c48b28c4395acbe66462d129370544d5be2bb7e764680b7da2eadc02f Jul 16 21:51:46.670811 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.670773 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" event={"ID":"c3804c34-53a9-41d4-8814-41ac6123fc45","Type":"ContainerStarted","Data":"eeffa50c48b28c4395acbe66462d129370544d5be2bb7e764680b7da2eadc02f"} Jul 16 21:51:46.761799 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:46.761129 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599dfbdcd9-9h8p6"] Jul 16 21:51:46.768692 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:46.768661 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6cc6959_2223_4216_a3f0_4cc62f0ebd95.slice/crio-f8fa41b6306ddec0e7d7f4cd74af5173f574bc478eda8f05a86d924c71999bfc WatchSource:0}: Error finding container f8fa41b6306ddec0e7d7f4cd74af5173f574bc478eda8f05a86d924c71999bfc: Status 404 returned error can't find the container with id f8fa41b6306ddec0e7d7f4cd74af5173f574bc478eda8f05a86d924c71999bfc Jul 16 21:51:47.567058 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.567027 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67b5dfb4-nrrfh" Jul 16 21:51:47.682443 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.682099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599dfbdcd9-9h8p6" event={"ID":"e6cc6959-2223-4216-a3f0-4cc62f0ebd95","Type":"ContainerStarted","Data":"0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae"} Jul 16 21:51:47.682443 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.682159 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599dfbdcd9-9h8p6" event={"ID":"e6cc6959-2223-4216-a3f0-4cc62f0ebd95","Type":"ContainerStarted","Data":"f8fa41b6306ddec0e7d7f4cd74af5173f574bc478eda8f05a86d924c71999bfc"} Jul 16 21:51:47.685045 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.684999 2580 generic.go:356] "Generic (PLEG): container finished" podID="e3764158-af2a-420e-ba70-806a535c1635" containerID="a043c5d66b442ebb17381b67b95ed1947dc33ea27a625eaf5c1dc349d8eb079f" exitCode=0 Jul 16 21:51:47.685521 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.685481 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qljp" event={"ID":"e3764158-af2a-420e-ba70-806a535c1635","Type":"ContainerDied","Data":"a043c5d66b442ebb17381b67b95ed1947dc33ea27a625eaf5c1dc349d8eb079f"} Jul 16 21:51:47.735399 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.735335 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-599dfbdcd9-9h8p6" podStartSLOduration=1.735314182 podStartE2EDuration="1.735314182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:47.734178551 +0000 UTC m=+96.035546856" watchObservedRunningTime="2026-07-16 21:51:47.735314182 +0000 UTC m=+96.036682488" Jul 16 21:51:47.891921 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.891222 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 21:51:47.910692 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.910669 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:47.922621 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.922130 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 21:51:47.922621 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.922177 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 21:51:47.922621 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.922193 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 21:51:47.922621 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.922242 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 21:51:47.922621 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.922466 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 21:51:47.923288 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.923242 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-48d73cofhq83p\"" Jul 16 21:51:47.925946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.924763 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jkk6m\"" Jul 16 21:51:47.925946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.924828 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 21:51:47.925946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.924918 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 21:51:47.925946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.924937 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 21:51:47.925946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.925043 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 21:51:47.925946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.925353 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 21:51:47.925946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.925399 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 21:51:47.925946 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.925534 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 21:51:47.927021 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.926698 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 21:51:47.933480 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.933443 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 21:51:47.961335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:47.959467 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 21:51:48.054424 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054383 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054733 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054929 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.054993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.055022 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.055044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.055075 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f69m6\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-kube-api-access-f69m6\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056086 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.055101 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056916 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.055143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056916 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.055172 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.056916 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.055205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.156782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.156847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.156882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.156906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.156939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f69m6\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-kube-api-access-f69m6\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.156969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157121 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.157789 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.158794 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.158794 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.158794 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.157410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.162388 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.159111 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.162388 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.159442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.162388 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.159636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.162388 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.159787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.162388 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.160679 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.162388 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.160923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.164456 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.163957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.164456 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.164009 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.164456 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.164036 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.166181 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.166159 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.170663 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.170621 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.172613 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.172380 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.177474 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.173390 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.177474 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.173476 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.177474 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.173943 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.177474 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.174349 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.177474 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.174778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.177474 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.177310 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f69m6\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-kube-api-access-f69m6\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.178475 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.178391 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.179182 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.179104 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.233405 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.231970 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:51:48.456270 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:51:48.456165 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ebc1fa_bd6b_49d2_8387_08ad3381465c.slice/crio-21485f025627654e3ac9b4f4fa9203b9643160659a760418791b151edb7e23da WatchSource:0}: Error finding container 21485f025627654e3ac9b4f4fa9203b9643160659a760418791b151edb7e23da: Status 404 returned error can't find the container with id 21485f025627654e3ac9b4f4fa9203b9643160659a760418791b151edb7e23da Jul 16 21:51:48.459655 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.459560 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 21:51:48.693196 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.693159 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qljp" event={"ID":"e3764158-af2a-420e-ba70-806a535c1635","Type":"ContainerStarted","Data":"3254074b4732f828242a7e2fde870ff92bba4edc0cebb5c03b68eeba13ad416e"} Jul 16 21:51:48.693735 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.693429 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qljp" event={"ID":"e3764158-af2a-420e-ba70-806a535c1635","Type":"ContainerStarted","Data":"b0b76ed6d04358c9dacb0e59924667dd3511e67193bbcaec9ba40d8f6b33b991"} Jul 16 21:51:48.694960 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.694929 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerStarted","Data":"21485f025627654e3ac9b4f4fa9203b9643160659a760418791b151edb7e23da"} Jul 16 21:51:48.698058 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.698025 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" event={"ID":"ca67f2f9-44cc-4f01-81e1-79471f090ccb","Type":"ContainerStarted","Data":"16d59d9a9a940d0c96248dd825d4a79ce4194166869a9ef246aeae9edc42e83c"} Jul 16 21:51:48.727561 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.727309 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6qljp" podStartSLOduration=6.199830254 podStartE2EDuration="7.727293265s" totalImagesPullingTime="1.411432974s" totalInitContainerRuntime="116.030037ms" isStatefulPod=true podCreationTimestamp="2026-07-16 21:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:48.725508186 +0000 UTC m=+97.026876492" watchObservedRunningTime="2026-07-16 21:51:48.727293265 +0000 UTC m=+97.028661568" Jul 16 21:51:48.759262 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:48.759207 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-pfzjq" podStartSLOduration=5.71695316 podStartE2EDuration="7.759185185s" totalImagesPullingTime="2.042232025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:48.756483926 +0000 UTC m=+97.057852232" watchObservedRunningTime="2026-07-16 21:51:48.759185185 +0000 UTC m=+97.060553488" Jul 16 21:51:50.208799 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:50.208747 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" podUID="550b8482-d6ca-4f12-a727-e867f6f2ac9d" containerName="registry" containerID="cri-o://a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7" gracePeriod=30 Jul 16 21:51:51.679396 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.679111 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:51:51.691546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.690928 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") pod \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " Jul 16 21:51:51.691546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.690999 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqt8s\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-kube-api-access-fqt8s\") pod \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " Jul 16 21:51:51.691546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.691030 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/550b8482-d6ca-4f12-a727-e867f6f2ac9d-ca-trust-extracted\") pod \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " Jul 16 21:51:51.691546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.691065 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-bound-sa-token\") pod \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " Jul 16 21:51:51.691546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.691105 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-trusted-ca\") pod \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " Jul 16 21:51:51.691546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.691131 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-certificates\") pod \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " Jul 16 21:51:51.691546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.691156 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-image-registry-private-configuration\") pod \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " Jul 16 21:51:51.691546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.691242 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-installation-pull-secrets\") pod \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\" (UID: \"550b8482-d6ca-4f12-a727-e867f6f2ac9d\") " Jul 16 21:51:51.692078 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.691975 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "550b8482-d6ca-4f12-a727-e867f6f2ac9d" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:51:51.692207 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.692186 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "550b8482-d6ca-4f12-a727-e867f6f2ac9d" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:51:51.694698 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.694654 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "550b8482-d6ca-4f12-a727-e867f6f2ac9d" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:51:51.697489 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.697355 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-kube-api-access-fqt8s" (OuterVolumeSpecName: "kube-api-access-fqt8s") pod "550b8482-d6ca-4f12-a727-e867f6f2ac9d" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d"). InnerVolumeSpecName "kube-api-access-fqt8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:51:51.707294 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.707264 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "550b8482-d6ca-4f12-a727-e867f6f2ac9d" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:51:51.707506 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.707460 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "550b8482-d6ca-4f12-a727-e867f6f2ac9d" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:51:51.707751 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.707702 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "550b8482-d6ca-4f12-a727-e867f6f2ac9d" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:51:51.709174 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.709151 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550b8482-d6ca-4f12-a727-e867f6f2ac9d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "550b8482-d6ca-4f12-a727-e867f6f2ac9d" (UID: "550b8482-d6ca-4f12-a727-e867f6f2ac9d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 21:51:51.716290 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.715684 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" event={"ID":"c3804c34-53a9-41d4-8814-41ac6123fc45","Type":"ContainerStarted","Data":"883157d6ef800b88a893e7fcb2dccea260599a1b11143caf811aee624bc109d6"} Jul 16 21:51:51.718556 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.718499 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dmh8v" event={"ID":"f80f4253-98c1-4664-8ea2-174537979a2d","Type":"ContainerStarted","Data":"4dbf56953f8a81c3fb3f0f989c800e8275ea6186fda48a37306bd18d178cc595"} Jul 16 21:51:51.719908 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.719879 2580 generic.go:356] "Generic (PLEG): container finished" podID="550b8482-d6ca-4f12-a727-e867f6f2ac9d" containerID="a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7" exitCode=0 Jul 16 21:51:51.719995 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.719947 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" event={"ID":"550b8482-d6ca-4f12-a727-e867f6f2ac9d","Type":"ContainerDied","Data":"a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7"} Jul 16 21:51:51.719995 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.719987 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" event={"ID":"550b8482-d6ca-4f12-a727-e867f6f2ac9d","Type":"ContainerDied","Data":"b228ecbf14cf819612fac2ca2c729972d678281cc9c1eec41fa4675efb27a2c9"} Jul 16 21:51:51.720084 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.720012 2580 scope.go:117] "RemoveContainer" containerID="a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7" Jul 16 21:51:51.720183 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.720166 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt" Jul 16 21:51:51.737499 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.737477 2580 scope.go:117] "RemoveContainer" containerID="a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7" Jul 16 21:51:51.738700 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:51:51.738485 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7\": container with ID starting with a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7 not found: ID does not exist" containerID="a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7" Jul 16 21:51:51.738700 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.738514 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7"} err="failed to get container status \"a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7\": rpc error: code = NotFound desc = could not find container \"a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7\": container with ID starting with a066ccd4251bc562069a108d7cc4a47f9d40fb8557f25c5680193687dc17edf7 not found: ID does not exist" Jul 16 21:51:51.791378 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.791305 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" podStartSLOduration=1.8248668289999999 podStartE2EDuration="6.791291312s" totalImagesPullingTime="4.966424483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:51.790137252 +0000 UTC m=+100.091505555" watchObservedRunningTime="2026-07-16 21:51:51.791291312 +0000 UTC m=+100.092659615" Jul 16 21:51:51.792531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.792100 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-installation-pull-secrets\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:51:51.792531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.792127 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-tls\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:51:51.792531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.792144 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqt8s\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-kube-api-access-fqt8s\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:51:51.792531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.792158 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/550b8482-d6ca-4f12-a727-e867f6f2ac9d-ca-trust-extracted\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:51:51.792531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.792172 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/550b8482-d6ca-4f12-a727-e867f6f2ac9d-bound-sa-token\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:51:51.792531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.792185 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-trusted-ca\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:51:51.792531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.792199 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/550b8482-d6ca-4f12-a727-e867f6f2ac9d-registry-certificates\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:51:51.792531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.792213 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/550b8482-d6ca-4f12-a727-e867f6f2ac9d-image-registry-private-configuration\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:51:51.835958 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.835887 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt"] Jul 16 21:51:51.845036 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:51.845015 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b7c6b9fd5-lmsxt"] Jul 16 21:51:52.235681 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:52.235646 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550b8482-d6ca-4f12-a727-e867f6f2ac9d" path="/var/lib/kubelet/pods/550b8482-d6ca-4f12-a727-e867f6f2ac9d/volumes" Jul 16 21:51:52.726229 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:52.726196 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerStarted","Data":"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23"} Jul 16 21:51:52.748830 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:52.748782 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dmh8v" podStartSLOduration=34.349780274 podStartE2EDuration="1m1.74876144s" totalImagesPullingTime="27.398981166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:52.747499696 +0000 UTC m=+101.048868005" watchObservedRunningTime="2026-07-16 21:51:52.74876144 +0000 UTC m=+101.050129745" Jul 16 21:51:53.733434 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:53.733401 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerID="adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23" exitCode=0 Jul 16 21:51:53.733915 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:53.733457 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerDied","Data":"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23"} Jul 16 21:51:55.529007 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:55.528975 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dqmwr" Jul 16 21:51:56.465014 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:56.464982 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:56.465253 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:56.465036 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:56.469884 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:56.469862 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:56.748347 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:56.748323 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:51:56.802572 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:56.802534 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c465ff78-zdvtt"] Jul 16 21:51:57.751233 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:57.751192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerStarted","Data":"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167"} Jul 16 21:51:57.751790 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:57.751273 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerStarted","Data":"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377"} Jul 16 21:51:59.764164 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:59.764131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerStarted","Data":"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23"} Jul 16 21:51:59.764520 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:59.764230 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerStarted","Data":"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc"} Jul 16 21:51:59.764520 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:59.764258 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerStarted","Data":"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174"} Jul 16 21:51:59.764520 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:59.764282 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerStarted","Data":"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd"} Jul 16 21:51:59.803190 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:51:59.803139 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.483277818 podStartE2EDuration="12.803119143s" totalImagesPullingTime="9.29861595s" totalInitContainerRuntime="21.225375ms" isStatefulPod=false podCreationTimestamp="2026-07-16 21:51:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:59.80005013 +0000 UTC m=+108.101418429" watchObservedRunningTime="2026-07-16 21:51:59.803119143 +0000 UTC m=+108.104487448" Jul 16 21:52:03.233649 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:03.233609 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:52:06.313416 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:06.313382 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:52:06.314050 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:06.313460 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:52:21.822308 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:21.822242 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c465ff78-zdvtt" podUID="c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" containerName="console" containerID="cri-o://cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a" gracePeriod=15 Jul 16 21:52:22.091989 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.091920 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:52:22.232973 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.232944 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-oauth-config\") pod \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " Jul 16 21:52:22.232973 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.232979 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26wtl\" (UniqueName: \"kubernetes.io/projected/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-kube-api-access-26wtl\") pod \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " Jul 16 21:52:22.233199 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.233004 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-serving-cert\") pod \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " Jul 16 21:52:22.233199 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.233044 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-service-ca\") pod \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " Jul 16 21:52:22.233199 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.233090 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-oauth-serving-cert\") pod \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " Jul 16 21:52:22.233199 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.233113 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-config\") pod \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " Jul 16 21:52:22.233199 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.233173 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-trusted-ca-bundle\") pod \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\" (UID: \"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7\") " Jul 16 21:52:22.233687 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.233494 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" (UID: "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:52:22.233687 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.233502 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" (UID: "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:52:22.233858 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.233708 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-config" (OuterVolumeSpecName: "console-config") pod "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" (UID: "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:52:22.233858 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.233769 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" (UID: "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:52:22.235600 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.235563 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" (UID: "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:52:22.235600 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.235569 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-kube-api-access-26wtl" (OuterVolumeSpecName: "kube-api-access-26wtl") pod "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" (UID: "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7"). InnerVolumeSpecName "kube-api-access-26wtl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:52:22.235775 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.235626 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" (UID: "c7680bc3-2e5b-46d5-b8c8-24507f4dedd7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:52:22.334090 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.334062 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26wtl\" (UniqueName: \"kubernetes.io/projected/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-kube-api-access-26wtl\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:52:22.334090 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.334085 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-serving-cert\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:52:22.334235 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.334098 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-service-ca\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:52:22.334235 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.334111 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-oauth-serving-cert\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:52:22.334235 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.334123 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:52:22.334235 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.334135 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-trusted-ca-bundle\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:52:22.334235 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.334146 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7-console-oauth-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:52:22.843917 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.843882 2580 generic.go:356] "Generic (PLEG): container finished" podID="c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" containerID="cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a" exitCode=0 Jul 16 21:52:22.844286 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.843941 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c465ff78-zdvtt" Jul 16 21:52:22.844286 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.843965 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c465ff78-zdvtt" event={"ID":"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7","Type":"ContainerDied","Data":"cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a"} Jul 16 21:52:22.844286 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.844039 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c465ff78-zdvtt" event={"ID":"c7680bc3-2e5b-46d5-b8c8-24507f4dedd7","Type":"ContainerDied","Data":"83e180fdf757b816dbe4a4b23aadae54523dd6d74f7f5d5d21350ff51dc30172"} Jul 16 21:52:22.844286 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.844060 2580 scope.go:117] "RemoveContainer" containerID="cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a" Jul 16 21:52:22.852149 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.852130 2580 scope.go:117] "RemoveContainer" containerID="cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a" Jul 16 21:52:22.852386 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:52:22.852368 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a\": container with ID starting with cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a not found: ID does not exist" containerID="cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a" Jul 16 21:52:22.852424 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.852393 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a"} err="failed to get container status \"cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a\": rpc error: code = NotFound desc = could not find container \"cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a\": container with ID starting with cd915e04d69ffcab7f3bbda936663cdc358e8ac1d5bf8026928f9a7663238c2a not found: ID does not exist" Jul 16 21:52:22.872136 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.872109 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c465ff78-zdvtt"] Jul 16 21:52:22.873292 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:22.873271 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c465ff78-zdvtt"] Jul 16 21:52:24.234110 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:24.234071 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" path="/var/lib/kubelet/pods/c7680bc3-2e5b-46d5-b8c8-24507f4dedd7/volumes" Jul 16 21:52:26.318464 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:26.318430 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:52:26.322181 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:26.322156 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9cc6d59b9-snrdr" Jul 16 21:52:48.234573 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:48.234540 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:52:48.251096 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:48.251068 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:52:48.954681 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:52:48.954654 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:06.338136 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.338099 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 21:53:06.338634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.338368 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="prometheus" containerID="cri-o://6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" gracePeriod=600 Jul 16 21:53:06.338634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.338429 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" gracePeriod=600 Jul 16 21:53:06.338634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.338382 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy" containerID="cri-o://92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" gracePeriod=600 Jul 16 21:53:06.338634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.338474 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy-web" containerID="cri-o://e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" gracePeriod=600 Jul 16 21:53:06.338634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.338412 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="thanos-sidecar" containerID="cri-o://dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" gracePeriod=600 Jul 16 21:53:06.338634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.338426 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="config-reloader" containerID="cri-o://ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" gracePeriod=600 Jul 16 21:53:06.579161 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.579135 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:06.666485 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666405 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-metrics-client-ca\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.666485 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666442 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-1\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.666485 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666467 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-metrics-client-certs\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.666764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666489 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-trusted-ca-bundle\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.666764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666508 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-thanos-prometheus-http-client-file\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.666764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666612 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-tls-assets\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.666764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666651 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.666764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666684 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-db\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.666764 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666732 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f69m6\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-kube-api-access-f69m6\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666769 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666799 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-kube-rbac-proxy\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666835 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666869 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666891 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-tls\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666916 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-web-config\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666946 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-0\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.666971 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-serving-certs-ca-bundle\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.667003 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config-out\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.667039 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-grpc-tls\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.667029 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:06.667101 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.667073 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-kubelet-serving-ca-bundle\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.667121 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-2\") pod \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\" (UID: \"d9ebc1fa-bd6b-49d2-8387-08ad3381465c\") " Jul 16 21:53:06.667659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.667136 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:06.667659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.667374 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-metrics-client-ca\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.667659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.667393 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.667659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.667409 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.668952 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.668574 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 21:53:06.668952 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.668822 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:06.669255 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.669205 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:06.669365 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.669277 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:06.669365 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.669307 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:53:06.670106 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.670078 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-kube-api-access-f69m6" (OuterVolumeSpecName: "kube-api-access-f69m6") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "kube-api-access-f69m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:53:06.670290 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.670264 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:06.670403 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.670269 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:06.670490 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.670305 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:06.670579 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.670350 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:06.670579 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.670400 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:06.671081 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.671060 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config" (OuterVolumeSpecName: "config") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:06.671310 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.671294 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config-out" (OuterVolumeSpecName: "config-out") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 21:53:06.671493 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.671470 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:06.672261 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.672232 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:06.672490 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.672475 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:06.681136 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.681110 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-web-config" (OuterVolumeSpecName: "web-config") pod "d9ebc1fa-bd6b-49d2-8387-08ad3381465c" (UID: "d9ebc1fa-bd6b-49d2-8387-08ad3381465c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:06.767885 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767848 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-metrics-client-certs\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.767885 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767881 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.767885 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767892 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-tls-assets\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767902 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767913 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-db\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767921 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f69m6\" (UniqueName: \"kubernetes.io/projected/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-kube-api-access-f69m6\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767929 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767937 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-kube-rbac-proxy\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767946 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767954 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767962 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-web-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767971 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767979 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767987 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-config-out\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.767996 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-secret-grpc-tls\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.768004 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:06.768094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:06.768013 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9ebc1fa-bd6b-49d2-8387-08ad3381465c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:07.005924 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.005888 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerID="1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" exitCode=0 Jul 16 21:53:07.005924 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.005917 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerID="92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" exitCode=0 Jul 16 21:53:07.005924 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.005925 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerID="e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" exitCode=0 Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.005934 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerID="dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" exitCode=0 Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.005942 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerID="ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" exitCode=0 Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.005949 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerID="6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" exitCode=0 Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.005980 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.005976 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerDied","Data":"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23"} Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.006046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerDied","Data":"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc"} Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.006075 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerDied","Data":"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174"} Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.006102 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerDied","Data":"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd"} Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.006118 2580 scope.go:117] "RemoveContainer" containerID="1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" Jul 16 21:53:07.006126 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.006127 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerDied","Data":"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167"} Jul 16 21:53:07.006447 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.006151 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerDied","Data":"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377"} Jul 16 21:53:07.006447 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.006175 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9ebc1fa-bd6b-49d2-8387-08ad3381465c","Type":"ContainerDied","Data":"21485f025627654e3ac9b4f4fa9203b9643160659a760418791b151edb7e23da"} Jul 16 21:53:07.014966 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.014942 2580 scope.go:117] "RemoveContainer" containerID="92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" Jul 16 21:53:07.022674 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.022653 2580 scope.go:117] "RemoveContainer" containerID="e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" Jul 16 21:53:07.028618 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.028605 2580 scope.go:117] "RemoveContainer" containerID="dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" Jul 16 21:53:07.032061 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.032041 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 21:53:07.035377 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.035349 2580 scope.go:117] "RemoveContainer" containerID="ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" Jul 16 21:53:07.037450 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.037426 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 21:53:07.041571 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.041554 2580 scope.go:117] "RemoveContainer" containerID="6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" Jul 16 21:53:07.047980 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.047965 2580 scope.go:117] "RemoveContainer" containerID="adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23" Jul 16 21:53:07.053937 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.053922 2580 scope.go:117] "RemoveContainer" containerID="1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" Jul 16 21:53:07.054157 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:53:07.054143 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": container with ID starting with 1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23 not found: ID does not exist" containerID="1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" Jul 16 21:53:07.054198 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.054164 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23"} err="failed to get container status \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": rpc error: code = NotFound desc = could not find container \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": container with ID starting with 1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23 not found: ID does not exist" Jul 16 21:53:07.054198 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.054180 2580 scope.go:117] "RemoveContainer" containerID="92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" Jul 16 21:53:07.054373 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:53:07.054355 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": container with ID starting with 92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc not found: ID does not exist" containerID="92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" Jul 16 21:53:07.054406 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.054378 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc"} err="failed to get container status \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": rpc error: code = NotFound desc = could not find container \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": container with ID starting with 92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc not found: ID does not exist" Jul 16 21:53:07.054406 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.054393 2580 scope.go:117] "RemoveContainer" containerID="e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" Jul 16 21:53:07.054599 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:53:07.054584 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": container with ID starting with e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174 not found: ID does not exist" containerID="e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" Jul 16 21:53:07.054634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.054603 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174"} err="failed to get container status \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": rpc error: code = NotFound desc = could not find container \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": container with ID starting with e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174 not found: ID does not exist" Jul 16 21:53:07.054634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.054615 2580 scope.go:117] "RemoveContainer" containerID="dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" Jul 16 21:53:07.054805 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:53:07.054791 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": container with ID starting with dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd not found: ID does not exist" containerID="dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" Jul 16 21:53:07.054849 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.054806 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd"} err="failed to get container status \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": rpc error: code = NotFound desc = could not find container \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": container with ID starting with dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd not found: ID does not exist" Jul 16 21:53:07.054849 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.054817 2580 scope.go:117] "RemoveContainer" containerID="ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" Jul 16 21:53:07.055009 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:53:07.054995 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": container with ID starting with ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167 not found: ID does not exist" containerID="ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" Jul 16 21:53:07.055051 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.055013 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167"} err="failed to get container status \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": rpc error: code = NotFound desc = could not find container \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": container with ID starting with ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167 not found: ID does not exist" Jul 16 21:53:07.055051 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.055024 2580 scope.go:117] "RemoveContainer" containerID="6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" Jul 16 21:53:07.055212 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:53:07.055197 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": container with ID starting with 6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377 not found: ID does not exist" containerID="6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" Jul 16 21:53:07.055247 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.055218 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377"} err="failed to get container status \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": rpc error: code = NotFound desc = could not find container \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": container with ID starting with 6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377 not found: ID does not exist" Jul 16 21:53:07.055247 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.055231 2580 scope.go:117] "RemoveContainer" containerID="adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23" Jul 16 21:53:07.055432 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:53:07.055417 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": container with ID starting with adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23 not found: ID does not exist" containerID="adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23" Jul 16 21:53:07.055473 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.055435 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23"} err="failed to get container status \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": rpc error: code = NotFound desc = could not find container \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": container with ID starting with adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23 not found: ID does not exist" Jul 16 21:53:07.055473 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.055447 2580 scope.go:117] "RemoveContainer" containerID="1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" Jul 16 21:53:07.055734 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.055679 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23"} err="failed to get container status \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": rpc error: code = NotFound desc = could not find container \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": container with ID starting with 1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23 not found: ID does not exist" Jul 16 21:53:07.055734 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.055700 2580 scope.go:117] "RemoveContainer" containerID="92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" Jul 16 21:53:07.056078 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056057 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc"} err="failed to get container status \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": rpc error: code = NotFound desc = could not find container \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": container with ID starting with 92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc not found: ID does not exist" Jul 16 21:53:07.056078 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056076 2580 scope.go:117] "RemoveContainer" containerID="e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" Jul 16 21:53:07.056307 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056288 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174"} err="failed to get container status \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": rpc error: code = NotFound desc = could not find container \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": container with ID starting with e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174 not found: ID does not exist" Jul 16 21:53:07.056378 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056308 2580 scope.go:117] "RemoveContainer" containerID="dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" Jul 16 21:53:07.056578 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056560 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd"} err="failed to get container status \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": rpc error: code = NotFound desc = could not find container \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": container with ID starting with dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd not found: ID does not exist" Jul 16 21:53:07.056630 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056579 2580 scope.go:117] "RemoveContainer" containerID="ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" Jul 16 21:53:07.056803 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056787 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167"} err="failed to get container status \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": rpc error: code = NotFound desc = could not find container \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": container with ID starting with ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167 not found: ID does not exist" Jul 16 21:53:07.056850 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056802 2580 scope.go:117] "RemoveContainer" containerID="6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" Jul 16 21:53:07.056988 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056974 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377"} err="failed to get container status \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": rpc error: code = NotFound desc = could not find container \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": container with ID starting with 6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377 not found: ID does not exist" Jul 16 21:53:07.057036 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.056989 2580 scope.go:117] "RemoveContainer" containerID="adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23" Jul 16 21:53:07.057209 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057191 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23"} err="failed to get container status \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": rpc error: code = NotFound desc = could not find container \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": container with ID starting with adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23 not found: ID does not exist" Jul 16 21:53:07.057257 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057209 2580 scope.go:117] "RemoveContainer" containerID="1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" Jul 16 21:53:07.057412 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057395 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23"} err="failed to get container status \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": rpc error: code = NotFound desc = could not find container \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": container with ID starting with 1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23 not found: ID does not exist" Jul 16 21:53:07.057451 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057412 2580 scope.go:117] "RemoveContainer" containerID="92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" Jul 16 21:53:07.057606 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057589 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc"} err="failed to get container status \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": rpc error: code = NotFound desc = could not find container \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": container with ID starting with 92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc not found: ID does not exist" Jul 16 21:53:07.057648 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057606 2580 scope.go:117] "RemoveContainer" containerID="e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" Jul 16 21:53:07.057799 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057782 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174"} err="failed to get container status \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": rpc error: code = NotFound desc = could not find container \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": container with ID starting with e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174 not found: ID does not exist" Jul 16 21:53:07.057847 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057799 2580 scope.go:117] "RemoveContainer" containerID="dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" Jul 16 21:53:07.057979 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057963 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd"} err="failed to get container status \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": rpc error: code = NotFound desc = could not find container \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": container with ID starting with dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd not found: ID does not exist" Jul 16 21:53:07.058019 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.057979 2580 scope.go:117] "RemoveContainer" containerID="ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" Jul 16 21:53:07.058167 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058150 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167"} err="failed to get container status \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": rpc error: code = NotFound desc = could not find container \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": container with ID starting with ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167 not found: ID does not exist" Jul 16 21:53:07.058208 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058168 2580 scope.go:117] "RemoveContainer" containerID="6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" Jul 16 21:53:07.058367 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058346 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377"} err="failed to get container status \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": rpc error: code = NotFound desc = could not find container \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": container with ID starting with 6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377 not found: ID does not exist" Jul 16 21:53:07.058406 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058369 2580 scope.go:117] "RemoveContainer" containerID="adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23" Jul 16 21:53:07.058547 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058533 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23"} err="failed to get container status \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": rpc error: code = NotFound desc = could not find container \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": container with ID starting with adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23 not found: ID does not exist" Jul 16 21:53:07.058587 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058547 2580 scope.go:117] "RemoveContainer" containerID="1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" Jul 16 21:53:07.058736 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058704 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23"} err="failed to get container status \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": rpc error: code = NotFound desc = could not find container \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": container with ID starting with 1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23 not found: ID does not exist" Jul 16 21:53:07.058781 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058737 2580 scope.go:117] "RemoveContainer" containerID="92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" Jul 16 21:53:07.058915 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058899 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc"} err="failed to get container status \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": rpc error: code = NotFound desc = could not find container \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": container with ID starting with 92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc not found: ID does not exist" Jul 16 21:53:07.058915 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.058915 2580 scope.go:117] "RemoveContainer" containerID="e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" Jul 16 21:53:07.059083 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059068 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174"} err="failed to get container status \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": rpc error: code = NotFound desc = could not find container \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": container with ID starting with e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174 not found: ID does not exist" Jul 16 21:53:07.059119 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059084 2580 scope.go:117] "RemoveContainer" containerID="dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" Jul 16 21:53:07.059242 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059225 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd"} err="failed to get container status \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": rpc error: code = NotFound desc = could not find container \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": container with ID starting with dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd not found: ID does not exist" Jul 16 21:53:07.059280 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059244 2580 scope.go:117] "RemoveContainer" containerID="ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" Jul 16 21:53:07.059472 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059455 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167"} err="failed to get container status \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": rpc error: code = NotFound desc = could not find container \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": container with ID starting with ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167 not found: ID does not exist" Jul 16 21:53:07.059472 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059471 2580 scope.go:117] "RemoveContainer" containerID="6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" Jul 16 21:53:07.059648 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059632 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377"} err="failed to get container status \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": rpc error: code = NotFound desc = could not find container \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": container with ID starting with 6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377 not found: ID does not exist" Jul 16 21:53:07.059688 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059648 2580 scope.go:117] "RemoveContainer" containerID="adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23" Jul 16 21:53:07.059865 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059849 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23"} err="failed to get container status \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": rpc error: code = NotFound desc = could not find container \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": container with ID starting with adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23 not found: ID does not exist" Jul 16 21:53:07.059865 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.059864 2580 scope.go:117] "RemoveContainer" containerID="1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" Jul 16 21:53:07.060058 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060039 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23"} err="failed to get container status \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": rpc error: code = NotFound desc = could not find container \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": container with ID starting with 1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23 not found: ID does not exist" Jul 16 21:53:07.060058 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060055 2580 scope.go:117] "RemoveContainer" containerID="92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" Jul 16 21:53:07.060230 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060215 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc"} err="failed to get container status \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": rpc error: code = NotFound desc = could not find container \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": container with ID starting with 92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc not found: ID does not exist" Jul 16 21:53:07.060276 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060230 2580 scope.go:117] "RemoveContainer" containerID="e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" Jul 16 21:53:07.060383 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060370 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174"} err="failed to get container status \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": rpc error: code = NotFound desc = could not find container \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": container with ID starting with e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174 not found: ID does not exist" Jul 16 21:53:07.060428 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060383 2580 scope.go:117] "RemoveContainer" containerID="dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" Jul 16 21:53:07.060527 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060514 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd"} err="failed to get container status \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": rpc error: code = NotFound desc = could not find container \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": container with ID starting with dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd not found: ID does not exist" Jul 16 21:53:07.060569 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060526 2580 scope.go:117] "RemoveContainer" containerID="ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" Jul 16 21:53:07.060686 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060672 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167"} err="failed to get container status \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": rpc error: code = NotFound desc = could not find container \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": container with ID starting with ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167 not found: ID does not exist" Jul 16 21:53:07.060747 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060685 2580 scope.go:117] "RemoveContainer" containerID="6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" Jul 16 21:53:07.060927 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060906 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377"} err="failed to get container status \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": rpc error: code = NotFound desc = could not find container \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": container with ID starting with 6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377 not found: ID does not exist" Jul 16 21:53:07.061001 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.060929 2580 scope.go:117] "RemoveContainer" containerID="adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23" Jul 16 21:53:07.061168 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061150 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23"} err="failed to get container status \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": rpc error: code = NotFound desc = could not find container \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": container with ID starting with adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23 not found: ID does not exist" Jul 16 21:53:07.061211 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061171 2580 scope.go:117] "RemoveContainer" containerID="1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23" Jul 16 21:53:07.061363 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061345 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23"} err="failed to get container status \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": rpc error: code = NotFound desc = could not find container \"1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23\": container with ID starting with 1cca9698cffa3ea0623a769f188ca389cadd7fc7599c752b212f5e440081fc23 not found: ID does not exist" Jul 16 21:53:07.061421 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061364 2580 scope.go:117] "RemoveContainer" containerID="92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc" Jul 16 21:53:07.061558 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061539 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc"} err="failed to get container status \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": rpc error: code = NotFound desc = could not find container \"92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc\": container with ID starting with 92dd0ce7b3e2f94c359e8cc0adb8c9637aa193af50a2c44215770441d826d6dc not found: ID does not exist" Jul 16 21:53:07.061601 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061559 2580 scope.go:117] "RemoveContainer" containerID="e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174" Jul 16 21:53:07.061773 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061750 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174"} err="failed to get container status \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": rpc error: code = NotFound desc = could not find container \"e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174\": container with ID starting with e601a54d6e68a91e7535230a5521bda0c9307dc7524e1dddc776cad61692d174 not found: ID does not exist" Jul 16 21:53:07.061844 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061773 2580 scope.go:117] "RemoveContainer" containerID="dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd" Jul 16 21:53:07.061968 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061947 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd"} err="failed to get container status \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": rpc error: code = NotFound desc = could not find container \"dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd\": container with ID starting with dce542a8b613e30fdb2fd3ca2bc5e554eb2e41899c1f284aca95cdd35f2e7bcd not found: ID does not exist" Jul 16 21:53:07.062010 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.061969 2580 scope.go:117] "RemoveContainer" containerID="ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167" Jul 16 21:53:07.062152 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.062138 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167"} err="failed to get container status \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": rpc error: code = NotFound desc = could not find container \"ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167\": container with ID starting with ad96da5e762b69622f579036463c5373623429699cb28fb7c6c68b19a6e79167 not found: ID does not exist" Jul 16 21:53:07.062194 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.062152 2580 scope.go:117] "RemoveContainer" containerID="6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377" Jul 16 21:53:07.062359 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.062340 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377"} err="failed to get container status \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": rpc error: code = NotFound desc = could not find container \"6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377\": container with ID starting with 6c1015af5f57e910f071889edda59ecdd1c6c2c9d89467f22b82d65933e44377 not found: ID does not exist" Jul 16 21:53:07.062410 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.062359 2580 scope.go:117] "RemoveContainer" containerID="adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23" Jul 16 21:53:07.062573 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.062558 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23"} err="failed to get container status \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": rpc error: code = NotFound desc = could not find container \"adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23\": container with ID starting with adaa800b4eea9de0535409112beb28fbd36506846c819713598bff0546149f23 not found: ID does not exist" Jul 16 21:53:07.066313 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066292 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 21:53:07.066591 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066575 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="config-reloader" Jul 16 21:53:07.066660 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066594 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="config-reloader" Jul 16 21:53:07.066660 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066608 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy" Jul 16 21:53:07.066660 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066616 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy" Jul 16 21:53:07.066660 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066629 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="prometheus" Jul 16 21:53:07.066660 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066638 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="prometheus" Jul 16 21:53:07.066660 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066652 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy-thanos" Jul 16 21:53:07.066660 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066660 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy-thanos" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066673 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="550b8482-d6ca-4f12-a727-e867f6f2ac9d" containerName="registry" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066680 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="550b8482-d6ca-4f12-a727-e867f6f2ac9d" containerName="registry" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066691 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="init-config-reloader" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066699 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="init-config-reloader" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066728 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="thanos-sidecar" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066736 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="thanos-sidecar" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066749 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" containerName="console" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066757 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" containerName="console" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066771 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy-web" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066779 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy-web" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066853 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066863 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy-thanos" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066873 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="prometheus" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066884 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="config-reloader" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066893 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7680bc3-2e5b-46d5-b8c8-24507f4dedd7" containerName="console" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066901 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="thanos-sidecar" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066910 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" containerName="kube-rbac-proxy-web" Jul 16 21:53:07.067039 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.066917 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="550b8482-d6ca-4f12-a727-e867f6f2ac9d" containerName="registry" Jul 16 21:53:07.070798 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.070781 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.073569 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.073553 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 21:53:07.073660 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.073553 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 21:53:07.074346 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.074328 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 21:53:07.074408 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.074388 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 21:53:07.074408 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.074400 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 21:53:07.074636 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.074619 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 21:53:07.074698 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.074657 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 21:53:07.074698 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.074676 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jkk6m\"" Jul 16 21:53:07.074698 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.074680 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 21:53:07.074840 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.074813 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 21:53:07.074887 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.074840 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 21:53:07.075089 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.075074 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 21:53:07.075089 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.075084 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 21:53:07.075619 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.075599 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-48d73cofhq83p\"" Jul 16 21:53:07.079036 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.079016 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 21:53:07.081462 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.081443 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 21:53:07.092195 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.092175 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 21:53:07.170897 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.170875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171000 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.170904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171000 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.170922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171000 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.170939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171000 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.170957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-config\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171142 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171142 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171142 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e5708fd-f730-40e9-8b4f-c941453444fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171142 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171142 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171142 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171181 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gpt6\" (UniqueName: \"kubernetes.io/projected/2e5708fd-f730-40e9-8b4f-c941453444fc-kube-api-access-5gpt6\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171206 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171278 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171300 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171335 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171332 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.171578 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.171350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e5708fd-f730-40e9-8b4f-c941453444fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.272571 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.272571 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272548 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.272571 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-config\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.272766 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.272766 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.272766 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e5708fd-f730-40e9-8b4f-c941453444fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.272766 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.272766 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273023 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273023 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273023 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gpt6\" (UniqueName: \"kubernetes.io/projected/2e5708fd-f730-40e9-8b4f-c941453444fc-kube-api-access-5gpt6\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273023 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273023 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273023 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273023 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273023 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273023 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.272998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273421 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.273047 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273421 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.273078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e5708fd-f730-40e9-8b4f-c941453444fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273421 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.273125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273421 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.273162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273617 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.273421 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.273958 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.273782 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.274494 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.274197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.274494 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.274424 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.275046 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.274945 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.275690 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.275664 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.275858 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.275837 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.276239 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.276210 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.276336 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.276289 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.276531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.276511 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e5708fd-f730-40e9-8b4f-c941453444fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.276682 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.276661 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-config\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.277128 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.277098 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.277538 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.277509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.277755 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.277738 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.277820 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.277781 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.277912 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.277897 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e5708fd-f730-40e9-8b4f-c941453444fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.278594 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.278573 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e5708fd-f730-40e9-8b4f-c941453444fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.278955 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.278938 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2e5708fd-f730-40e9-8b4f-c941453444fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.283580 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.283565 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gpt6\" (UniqueName: \"kubernetes.io/projected/2e5708fd-f730-40e9-8b4f-c941453444fc-kube-api-access-5gpt6\") pod \"prometheus-k8s-0\" (UID: \"2e5708fd-f730-40e9-8b4f-c941453444fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.380997 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.380974 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:07.517165 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:07.517139 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 21:53:07.519053 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:53:07.519017 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5708fd_f730_40e9_8b4f_c941453444fc.slice/crio-3cfa13641d6f0d8dd11e7e893bf1eabce287ea9df5ff05d94dc024f94ecbb49d WatchSource:0}: Error finding container 3cfa13641d6f0d8dd11e7e893bf1eabce287ea9df5ff05d94dc024f94ecbb49d: Status 404 returned error can't find the container with id 3cfa13641d6f0d8dd11e7e893bf1eabce287ea9df5ff05d94dc024f94ecbb49d Jul 16 21:53:08.011588 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:08.011550 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e5708fd-f730-40e9-8b4f-c941453444fc" containerID="31e23804d5ec9631d5998d966a6d4dc8fae734cd6a3e470ea96f6d3f17796c22" exitCode=0 Jul 16 21:53:08.011743 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:08.011671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e5708fd-f730-40e9-8b4f-c941453444fc","Type":"ContainerDied","Data":"31e23804d5ec9631d5998d966a6d4dc8fae734cd6a3e470ea96f6d3f17796c22"} Jul 16 21:53:08.011795 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:08.011765 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e5708fd-f730-40e9-8b4f-c941453444fc","Type":"ContainerStarted","Data":"3cfa13641d6f0d8dd11e7e893bf1eabce287ea9df5ff05d94dc024f94ecbb49d"} Jul 16 21:53:08.238606 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:08.238569 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9ebc1fa-bd6b-49d2-8387-08ad3381465c" path="/var/lib/kubelet/pods/d9ebc1fa-bd6b-49d2-8387-08ad3381465c/volumes" Jul 16 21:53:09.019641 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.019608 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e5708fd-f730-40e9-8b4f-c941453444fc","Type":"ContainerStarted","Data":"94838d6480dd61235e21a10a074b95028614dc5862a12eabe6f12de8b9ead145"} Jul 16 21:53:09.020015 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.019669 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e5708fd-f730-40e9-8b4f-c941453444fc","Type":"ContainerStarted","Data":"296acd7366d65025342cc78ee0db2e553ffa75b252e8d39dd019c947462ddadb"} Jul 16 21:53:09.020015 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.019696 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e5708fd-f730-40e9-8b4f-c941453444fc","Type":"ContainerStarted","Data":"cfcb3c717c855fe1095f6438d474730d6bdadc1d861b86aa66998491173e7545"} Jul 16 21:53:09.020015 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.019735 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e5708fd-f730-40e9-8b4f-c941453444fc","Type":"ContainerStarted","Data":"833e53cced771dc29f5f9249c86a57f4a500344ec3303bad8045900625d70d34"} Jul 16 21:53:09.020015 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.019758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e5708fd-f730-40e9-8b4f-c941453444fc","Type":"ContainerStarted","Data":"d46fe4279c76584dbb8086a78b5ab9dcef09cdf3516c6b42cd6f800b09dac27a"} Jul 16 21:53:09.020015 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.019779 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e5708fd-f730-40e9-8b4f-c941453444fc","Type":"ContainerStarted","Data":"da6b136989a016d803ff3f091e73312df066edd68fa2dab51d63fc682cec3a43"} Jul 16 21:53:09.053226 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.053175 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.033505448 podStartE2EDuration="2.053159518s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.65407ms" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:53:09.051792012 +0000 UTC m=+177.353160316" watchObservedRunningTime="2026-07-16 21:53:09.053159518 +0000 UTC m=+177.354527822" Jul 16 21:53:09.190745 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.190699 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d48dbbd55-hlhmr"] Jul 16 21:53:09.193559 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.193543 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.204753 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.204730 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d48dbbd55-hlhmr"] Jul 16 21:53:09.287400 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.287312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-service-ca\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.287400 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.287346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-oauth-config\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.287400 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.287362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmcgp\" (UniqueName: \"kubernetes.io/projected/9feaf8bb-6390-4f84-a106-93416649b339-kube-api-access-mmcgp\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.287634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.287414 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-trusted-ca-bundle\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.287634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.287458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-serving-cert\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.287634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.287537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-console-config\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.287634 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.287597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-oauth-serving-cert\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.388791 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.388751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-service-ca\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.388791 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.388793 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-oauth-config\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.389017 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.388811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmcgp\" (UniqueName: \"kubernetes.io/projected/9feaf8bb-6390-4f84-a106-93416649b339-kube-api-access-mmcgp\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.389017 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.388943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-trusted-ca-bundle\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.389017 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.388981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-serving-cert\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.389163 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.389048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-console-config\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.389163 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.389091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-oauth-serving-cert\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.389579 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.389547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-service-ca\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.389698 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.389680 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-oauth-serving-cert\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.389889 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.389866 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-console-config\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.389964 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.389900 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-trusted-ca-bundle\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.391305 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.391268 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-serving-cert\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.391396 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.391346 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-oauth-config\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.398706 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.398686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmcgp\" (UniqueName: \"kubernetes.io/projected/9feaf8bb-6390-4f84-a106-93416649b339-kube-api-access-mmcgp\") pod \"console-7d48dbbd55-hlhmr\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.502815 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.502785 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:09.628286 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:09.628231 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d48dbbd55-hlhmr"] Jul 16 21:53:09.630884 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:53:09.630856 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9feaf8bb_6390_4f84_a106_93416649b339.slice/crio-561976c688f429ea1e75eb2a533759b2e7ee2099bb1d09f24633a9bbdd97a458 WatchSource:0}: Error finding container 561976c688f429ea1e75eb2a533759b2e7ee2099bb1d09f24633a9bbdd97a458: Status 404 returned error can't find the container with id 561976c688f429ea1e75eb2a533759b2e7ee2099bb1d09f24633a9bbdd97a458 Jul 16 21:53:10.025094 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:10.025055 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d48dbbd55-hlhmr" event={"ID":"9feaf8bb-6390-4f84-a106-93416649b339","Type":"ContainerStarted","Data":"77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9"} Jul 16 21:53:10.025583 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:10.025110 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d48dbbd55-hlhmr" event={"ID":"9feaf8bb-6390-4f84-a106-93416649b339","Type":"ContainerStarted","Data":"561976c688f429ea1e75eb2a533759b2e7ee2099bb1d09f24633a9bbdd97a458"} Jul 16 21:53:10.045930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:10.045885 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d48dbbd55-hlhmr" podStartSLOduration=1.045869359 podStartE2EDuration="1.045869359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:53:10.045338955 +0000 UTC m=+178.346707259" watchObservedRunningTime="2026-07-16 21:53:10.045869359 +0000 UTC m=+178.347237662" Jul 16 21:53:12.381740 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:12.381627 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:53:19.503213 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:19.503168 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:19.503602 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:19.503237 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:19.507835 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:19.507813 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:20.068499 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:20.068469 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:53:20.164908 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:20.164861 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-599dfbdcd9-9h8p6"] Jul 16 21:53:45.184279 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.184216 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-599dfbdcd9-9h8p6" podUID="e6cc6959-2223-4216-a3f0-4cc62f0ebd95" containerName="console" containerID="cri-o://0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae" gracePeriod=15 Jul 16 21:53:45.439615 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.439199 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:53:45.599481 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.599451 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-service-ca\") pod \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " Jul 16 21:53:45.599659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.599494 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-config\") pod \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " Jul 16 21:53:45.599659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.599550 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-oauth-serving-cert\") pod \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " Jul 16 21:53:45.599659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.599577 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-trusted-ca-bundle\") pod \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " Jul 16 21:53:45.599659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.599630 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-oauth-config\") pod \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " Jul 16 21:53:45.599659 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.599650 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgjbw\" (UniqueName: \"kubernetes.io/projected/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-kube-api-access-qgjbw\") pod \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " Jul 16 21:53:45.599942 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.599672 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-serving-cert\") pod \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\" (UID: \"e6cc6959-2223-4216-a3f0-4cc62f0ebd95\") " Jul 16 21:53:45.599942 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.599902 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-service-ca" (OuterVolumeSpecName: "service-ca") pod "e6cc6959-2223-4216-a3f0-4cc62f0ebd95" (UID: "e6cc6959-2223-4216-a3f0-4cc62f0ebd95"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:45.600040 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.599984 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e6cc6959-2223-4216-a3f0-4cc62f0ebd95" (UID: "e6cc6959-2223-4216-a3f0-4cc62f0ebd95"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:45.600040 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.600023 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-config" (OuterVolumeSpecName: "console-config") pod "e6cc6959-2223-4216-a3f0-4cc62f0ebd95" (UID: "e6cc6959-2223-4216-a3f0-4cc62f0ebd95"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:45.600137 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.600115 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e6cc6959-2223-4216-a3f0-4cc62f0ebd95" (UID: "e6cc6959-2223-4216-a3f0-4cc62f0ebd95"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:53:45.601786 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.601754 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e6cc6959-2223-4216-a3f0-4cc62f0ebd95" (UID: "e6cc6959-2223-4216-a3f0-4cc62f0ebd95"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:45.601905 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.601802 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-kube-api-access-qgjbw" (OuterVolumeSpecName: "kube-api-access-qgjbw") pod "e6cc6959-2223-4216-a3f0-4cc62f0ebd95" (UID: "e6cc6959-2223-4216-a3f0-4cc62f0ebd95"). InnerVolumeSpecName "kube-api-access-qgjbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:53:45.601905 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.601843 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e6cc6959-2223-4216-a3f0-4cc62f0ebd95" (UID: "e6cc6959-2223-4216-a3f0-4cc62f0ebd95"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:53:45.701278 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.701198 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:45.701278 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.701225 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-oauth-serving-cert\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:45.701278 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.701235 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-trusted-ca-bundle\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:45.701278 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.701243 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-oauth-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:45.701278 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.701253 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgjbw\" (UniqueName: \"kubernetes.io/projected/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-kube-api-access-qgjbw\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:45.701278 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.701261 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-console-serving-cert\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:45.701278 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:45.701269 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6cc6959-2223-4216-a3f0-4cc62f0ebd95-service-ca\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:53:46.160006 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.159973 2580 generic.go:356] "Generic (PLEG): container finished" podID="e6cc6959-2223-4216-a3f0-4cc62f0ebd95" containerID="0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae" exitCode=0 Jul 16 21:53:46.160207 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.160021 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599dfbdcd9-9h8p6" Jul 16 21:53:46.160207 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.160055 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599dfbdcd9-9h8p6" event={"ID":"e6cc6959-2223-4216-a3f0-4cc62f0ebd95","Type":"ContainerDied","Data":"0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae"} Jul 16 21:53:46.160207 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.160132 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599dfbdcd9-9h8p6" event={"ID":"e6cc6959-2223-4216-a3f0-4cc62f0ebd95","Type":"ContainerDied","Data":"f8fa41b6306ddec0e7d7f4cd74af5173f574bc478eda8f05a86d924c71999bfc"} Jul 16 21:53:46.160207 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.160151 2580 scope.go:117] "RemoveContainer" containerID="0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae" Jul 16 21:53:46.168589 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.168572 2580 scope.go:117] "RemoveContainer" containerID="0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae" Jul 16 21:53:46.168853 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:53:46.168834 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae\": container with ID starting with 0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae not found: ID does not exist" containerID="0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae" Jul 16 21:53:46.168932 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.168861 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae"} err="failed to get container status \"0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae\": rpc error: code = NotFound desc = could not find container \"0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae\": container with ID starting with 0b3be8ced840aa0bef04183bf28e1653dbd9fd4c3b45ed26513097652498edae not found: ID does not exist" Jul 16 21:53:46.182493 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.182468 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-599dfbdcd9-9h8p6"] Jul 16 21:53:46.186734 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.186698 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-599dfbdcd9-9h8p6"] Jul 16 21:53:46.235033 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:53:46.235012 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6cc6959-2223-4216-a3f0-4cc62f0ebd95" path="/var/lib/kubelet/pods/e6cc6959-2223-4216-a3f0-4cc62f0ebd95/volumes" Jul 16 21:54:07.381671 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:07.381631 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:54:07.396382 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:07.396347 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:54:08.251056 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:08.251029 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 21:54:27.929103 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:27.929065 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-759764b84-4wldh"] Jul 16 21:54:27.929566 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:27.929345 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6cc6959-2223-4216-a3f0-4cc62f0ebd95" containerName="console" Jul 16 21:54:27.929566 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:27.929355 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6cc6959-2223-4216-a3f0-4cc62f0ebd95" containerName="console" Jul 16 21:54:27.929566 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:27.929413 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6cc6959-2223-4216-a3f0-4cc62f0ebd95" containerName="console" Jul 16 21:54:27.932016 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:27.931995 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:27.945227 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:27.945201 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759764b84-4wldh"] Jul 16 21:54:28.003735 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.003687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-serving-cert\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.003915 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.003754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-oauth-config\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.003915 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.003843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-service-ca\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.003915 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.003892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-console-config\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.003915 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.003915 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdxl4\" (UniqueName: \"kubernetes.io/projected/3a764364-0279-4011-9897-f059b4ea12ea-kube-api-access-cdxl4\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.004043 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.003945 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-oauth-serving-cert\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.004043 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.003986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-trusted-ca-bundle\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.105153 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.105097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-oauth-config\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.105333 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.105191 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-service-ca\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.105333 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.105215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-console-config\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.105333 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.105230 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdxl4\" (UniqueName: \"kubernetes.io/projected/3a764364-0279-4011-9897-f059b4ea12ea-kube-api-access-cdxl4\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.105333 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.105255 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-oauth-serving-cert\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.105333 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.105314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-trusted-ca-bundle\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.105575 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.105381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-serving-cert\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.106097 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.106065 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-console-config\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.106220 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.106115 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-oauth-serving-cert\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.106220 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.106115 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-service-ca\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.106450 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.106431 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-trusted-ca-bundle\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.107616 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.107589 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-serving-cert\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.107739 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.107695 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-oauth-config\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.114485 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.114466 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdxl4\" (UniqueName: \"kubernetes.io/projected/3a764364-0279-4011-9897-f059b4ea12ea-kube-api-access-cdxl4\") pod \"console-759764b84-4wldh\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.240678 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.240651 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:28.372930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:28.372816 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759764b84-4wldh"] Jul 16 21:54:28.375466 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:54:28.375428 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a764364_0279_4011_9897_f059b4ea12ea.slice/crio-2b97f55ea88c47d5599a5befde05fd993501099764cb56d8dfe9e2d45b031202 WatchSource:0}: Error finding container 2b97f55ea88c47d5599a5befde05fd993501099764cb56d8dfe9e2d45b031202: Status 404 returned error can't find the container with id 2b97f55ea88c47d5599a5befde05fd993501099764cb56d8dfe9e2d45b031202 Jul 16 21:54:29.307546 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:29.307509 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759764b84-4wldh" event={"ID":"3a764364-0279-4011-9897-f059b4ea12ea","Type":"ContainerStarted","Data":"cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8"} Jul 16 21:54:29.307947 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:29.307556 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759764b84-4wldh" event={"ID":"3a764364-0279-4011-9897-f059b4ea12ea","Type":"ContainerStarted","Data":"2b97f55ea88c47d5599a5befde05fd993501099764cb56d8dfe9e2d45b031202"} Jul 16 21:54:29.328770 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:29.328701 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-759764b84-4wldh" podStartSLOduration=2.328685539 podStartE2EDuration="2.328685539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:54:29.327572765 +0000 UTC m=+257.628941066" watchObservedRunningTime="2026-07-16 21:54:29.328685539 +0000 UTC m=+257.630053844" Jul 16 21:54:38.241481 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:38.241403 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:38.241481 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:38.241459 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:38.246261 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:38.246232 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:38.341176 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:38.341149 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-759764b84-4wldh" Jul 16 21:54:38.429145 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:54:38.429115 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d48dbbd55-hlhmr"] Jul 16 21:55:03.455727 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.455664 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d48dbbd55-hlhmr" podUID="9feaf8bb-6390-4f84-a106-93416649b339" containerName="console" containerID="cri-o://77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9" gracePeriod=15 Jul 16 21:55:03.700445 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.700423 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:55:03.713670 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.713616 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-trusted-ca-bundle\") pod \"9feaf8bb-6390-4f84-a106-93416649b339\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " Jul 16 21:55:03.713670 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.713651 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-oauth-config\") pod \"9feaf8bb-6390-4f84-a106-93416649b339\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " Jul 16 21:55:03.713913 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.713684 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-service-ca\") pod \"9feaf8bb-6390-4f84-a106-93416649b339\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " Jul 16 21:55:03.713913 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.713731 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-oauth-serving-cert\") pod \"9feaf8bb-6390-4f84-a106-93416649b339\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " Jul 16 21:55:03.713913 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.713761 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-serving-cert\") pod \"9feaf8bb-6390-4f84-a106-93416649b339\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " Jul 16 21:55:03.713913 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.713805 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-console-config\") pod \"9feaf8bb-6390-4f84-a106-93416649b339\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " Jul 16 21:55:03.713913 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.713830 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmcgp\" (UniqueName: \"kubernetes.io/projected/9feaf8bb-6390-4f84-a106-93416649b339-kube-api-access-mmcgp\") pod \"9feaf8bb-6390-4f84-a106-93416649b339\" (UID: \"9feaf8bb-6390-4f84-a106-93416649b339\") " Jul 16 21:55:03.714155 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.714125 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-service-ca" (OuterVolumeSpecName: "service-ca") pod "9feaf8bb-6390-4f84-a106-93416649b339" (UID: "9feaf8bb-6390-4f84-a106-93416649b339"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:55:03.714200 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.714182 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9feaf8bb-6390-4f84-a106-93416649b339" (UID: "9feaf8bb-6390-4f84-a106-93416649b339"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:55:03.714243 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.714220 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-console-config" (OuterVolumeSpecName: "console-config") pod "9feaf8bb-6390-4f84-a106-93416649b339" (UID: "9feaf8bb-6390-4f84-a106-93416649b339"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:55:03.714358 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.714226 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9feaf8bb-6390-4f84-a106-93416649b339" (UID: "9feaf8bb-6390-4f84-a106-93416649b339"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:55:03.715759 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.715725 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9feaf8bb-6390-4f84-a106-93416649b339" (UID: "9feaf8bb-6390-4f84-a106-93416649b339"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:55:03.715870 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.715808 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9feaf8bb-6390-4f84-a106-93416649b339" (UID: "9feaf8bb-6390-4f84-a106-93416649b339"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:55:03.715870 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.715833 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9feaf8bb-6390-4f84-a106-93416649b339-kube-api-access-mmcgp" (OuterVolumeSpecName: "kube-api-access-mmcgp") pod "9feaf8bb-6390-4f84-a106-93416649b339" (UID: "9feaf8bb-6390-4f84-a106-93416649b339"). InnerVolumeSpecName "kube-api-access-mmcgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:55:03.814816 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.814783 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-serving-cert\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:55:03.814816 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.814814 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-console-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:55:03.814816 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.814824 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmcgp\" (UniqueName: \"kubernetes.io/projected/9feaf8bb-6390-4f84-a106-93416649b339-kube-api-access-mmcgp\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:55:03.815037 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.814833 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-trusted-ca-bundle\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:55:03.815037 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.814841 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9feaf8bb-6390-4f84-a106-93416649b339-console-oauth-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:55:03.815037 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.814849 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-service-ca\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:55:03.815037 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:03.814857 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9feaf8bb-6390-4f84-a106-93416649b339-oauth-serving-cert\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:55:04.434811 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:04.434778 2580 generic.go:356] "Generic (PLEG): container finished" podID="9feaf8bb-6390-4f84-a106-93416649b339" containerID="77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9" exitCode=0 Jul 16 21:55:04.434969 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:04.434818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d48dbbd55-hlhmr" event={"ID":"9feaf8bb-6390-4f84-a106-93416649b339","Type":"ContainerDied","Data":"77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9"} Jul 16 21:55:04.434969 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:04.434828 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d48dbbd55-hlhmr" Jul 16 21:55:04.434969 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:04.434857 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d48dbbd55-hlhmr" event={"ID":"9feaf8bb-6390-4f84-a106-93416649b339","Type":"ContainerDied","Data":"561976c688f429ea1e75eb2a533759b2e7ee2099bb1d09f24633a9bbdd97a458"} Jul 16 21:55:04.434969 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:04.434876 2580 scope.go:117] "RemoveContainer" containerID="77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9" Jul 16 21:55:04.442437 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:04.442419 2580 scope.go:117] "RemoveContainer" containerID="77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9" Jul 16 21:55:04.442705 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:55:04.442681 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9\": container with ID starting with 77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9 not found: ID does not exist" containerID="77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9" Jul 16 21:55:04.442787 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:04.442731 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9"} err="failed to get container status \"77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9\": rpc error: code = NotFound desc = could not find container \"77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9\": container with ID starting with 77c3df386fc62b97ba605e00ad062ca29d91a9ebed78a48deec1a0bb850e91b9 not found: ID does not exist" Jul 16 21:55:04.452489 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:04.452467 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d48dbbd55-hlhmr"] Jul 16 21:55:04.455965 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:04.455940 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d48dbbd55-hlhmr"] Jul 16 21:55:06.234533 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:06.234500 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9feaf8bb-6390-4f84-a106-93416649b339" path="/var/lib/kubelet/pods/9feaf8bb-6390-4f84-a106-93416649b339/volumes" Jul 16 21:55:12.073099 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:12.073074 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 21:55:12.080100 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:12.080069 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 21:55:12.082752 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:55:12.082730 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 21:58:11.226992 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.226947 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677957b8f4-b844p"] Jul 16 21:58:11.227581 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.227391 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9feaf8bb-6390-4f84-a106-93416649b339" containerName="console" Jul 16 21:58:11.227581 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.227413 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9feaf8bb-6390-4f84-a106-93416649b339" containerName="console" Jul 16 21:58:11.227581 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.227510 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9feaf8bb-6390-4f84-a106-93416649b339" containerName="console" Jul 16 21:58:11.230578 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.230553 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.241514 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.241489 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677957b8f4-b844p"] Jul 16 21:58:11.296810 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.296784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0b95e5c-8ba6-4434-b99d-731f2d76d943-console-oauth-config\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.296910 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.296817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-console-config\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.296910 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.296853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cmx5\" (UniqueName: \"kubernetes.io/projected/e0b95e5c-8ba6-4434-b99d-731f2d76d943-kube-api-access-6cmx5\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.296910 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.296879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-oauth-serving-cert\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.297026 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.296918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-service-ca\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.297026 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.296984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b95e5c-8ba6-4434-b99d-731f2d76d943-console-serving-cert\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.297026 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.297013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-trusted-ca-bundle\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.397612 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.397587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-console-config\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.397768 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.397623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cmx5\" (UniqueName: \"kubernetes.io/projected/e0b95e5c-8ba6-4434-b99d-731f2d76d943-kube-api-access-6cmx5\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.397768 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.397643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-oauth-serving-cert\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.397768 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.397668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-service-ca\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.397768 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.397692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b95e5c-8ba6-4434-b99d-731f2d76d943-console-serving-cert\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.397768 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.397707 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-trusted-ca-bundle\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.397768 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.397747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0b95e5c-8ba6-4434-b99d-731f2d76d943-console-oauth-config\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.398358 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.398332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-console-config\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.398450 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.398433 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-service-ca\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.398491 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.398454 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-oauth-serving-cert\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.398531 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.398502 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0b95e5c-8ba6-4434-b99d-731f2d76d943-trusted-ca-bundle\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.399905 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.399882 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b95e5c-8ba6-4434-b99d-731f2d76d943-console-serving-cert\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.399988 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.399933 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0b95e5c-8ba6-4434-b99d-731f2d76d943-console-oauth-config\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.406875 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.406857 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cmx5\" (UniqueName: \"kubernetes.io/projected/e0b95e5c-8ba6-4434-b99d-731f2d76d943-kube-api-access-6cmx5\") pod \"console-677957b8f4-b844p\" (UID: \"e0b95e5c-8ba6-4434-b99d-731f2d76d943\") " pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.539816 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.539761 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:11.662768 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:11.662553 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677957b8f4-b844p"] Jul 16 21:58:11.665973 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:58:11.665947 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b95e5c_8ba6_4434_b99d_731f2d76d943.slice/crio-072e9b8714d87597c216c17b8c18c03d7cf9a72cbfd167666c72d56ca118ce2b WatchSource:0}: Error finding container 072e9b8714d87597c216c17b8c18c03d7cf9a72cbfd167666c72d56ca118ce2b: Status 404 returned error can't find the container with id 072e9b8714d87597c216c17b8c18c03d7cf9a72cbfd167666c72d56ca118ce2b Jul 16 21:58:12.123171 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:12.123135 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677957b8f4-b844p" event={"ID":"e0b95e5c-8ba6-4434-b99d-731f2d76d943","Type":"ContainerStarted","Data":"0fe2616d4a38a86ca1645fffb4a55c3339c0187448c9f5aeddf81834cfa627cd"} Jul 16 21:58:12.123344 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:12.123221 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677957b8f4-b844p" event={"ID":"e0b95e5c-8ba6-4434-b99d-731f2d76d943","Type":"ContainerStarted","Data":"072e9b8714d87597c216c17b8c18c03d7cf9a72cbfd167666c72d56ca118ce2b"} Jul 16 21:58:12.144223 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:12.144184 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677957b8f4-b844p" podStartSLOduration=1.144172567 podStartE2EDuration="1.144172567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:12.142584982 +0000 UTC m=+480.443953289" watchObservedRunningTime="2026-07-16 21:58:12.144172567 +0000 UTC m=+480.445540870" Jul 16 21:58:21.540459 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:21.540421 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:21.540962 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:21.540522 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:21.544855 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:21.544836 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:22.164930 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:22.164898 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677957b8f4-b844p" Jul 16 21:58:22.216680 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:22.216642 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759764b84-4wldh"] Jul 16 21:58:47.239823 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.239784 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-759764b84-4wldh" podUID="3a764364-0279-4011-9897-f059b4ea12ea" containerName="console" containerID="cri-o://cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8" gracePeriod=15 Jul 16 21:58:47.476287 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.476262 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759764b84-4wldh" Jul 16 21:58:47.554009 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.553932 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-oauth-config\") pod \"3a764364-0279-4011-9897-f059b4ea12ea\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " Jul 16 21:58:47.554009 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.553972 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-serving-cert\") pod \"3a764364-0279-4011-9897-f059b4ea12ea\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " Jul 16 21:58:47.554009 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.553990 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdxl4\" (UniqueName: \"kubernetes.io/projected/3a764364-0279-4011-9897-f059b4ea12ea-kube-api-access-cdxl4\") pod \"3a764364-0279-4011-9897-f059b4ea12ea\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " Jul 16 21:58:47.554009 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.554011 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-console-config\") pod \"3a764364-0279-4011-9897-f059b4ea12ea\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " Jul 16 21:58:47.554316 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.554087 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-trusted-ca-bundle\") pod \"3a764364-0279-4011-9897-f059b4ea12ea\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " Jul 16 21:58:47.554316 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.554144 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-oauth-serving-cert\") pod \"3a764364-0279-4011-9897-f059b4ea12ea\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " Jul 16 21:58:47.554316 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.554172 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-service-ca\") pod \"3a764364-0279-4011-9897-f059b4ea12ea\" (UID: \"3a764364-0279-4011-9897-f059b4ea12ea\") " Jul 16 21:58:47.554454 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.554347 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-console-config" (OuterVolumeSpecName: "console-config") pod "3a764364-0279-4011-9897-f059b4ea12ea" (UID: "3a764364-0279-4011-9897-f059b4ea12ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:58:47.554799 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.554574 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-console-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:58:47.554799 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.554582 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3a764364-0279-4011-9897-f059b4ea12ea" (UID: "3a764364-0279-4011-9897-f059b4ea12ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:58:47.554799 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.554632 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "3a764364-0279-4011-9897-f059b4ea12ea" (UID: "3a764364-0279-4011-9897-f059b4ea12ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:58:47.554984 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.554820 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3a764364-0279-4011-9897-f059b4ea12ea" (UID: "3a764364-0279-4011-9897-f059b4ea12ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:58:47.556150 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.556125 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3a764364-0279-4011-9897-f059b4ea12ea" (UID: "3a764364-0279-4011-9897-f059b4ea12ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:58:47.556217 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.556162 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3a764364-0279-4011-9897-f059b4ea12ea" (UID: "3a764364-0279-4011-9897-f059b4ea12ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:58:47.556558 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.556541 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a764364-0279-4011-9897-f059b4ea12ea-kube-api-access-cdxl4" (OuterVolumeSpecName: "kube-api-access-cdxl4") pod "3a764364-0279-4011-9897-f059b4ea12ea" (UID: "3a764364-0279-4011-9897-f059b4ea12ea"). InnerVolumeSpecName "kube-api-access-cdxl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:58:47.655242 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.655203 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-oauth-config\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:58:47.655242 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.655238 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a764364-0279-4011-9897-f059b4ea12ea-console-serving-cert\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:58:47.655242 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.655251 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdxl4\" (UniqueName: \"kubernetes.io/projected/3a764364-0279-4011-9897-f059b4ea12ea-kube-api-access-cdxl4\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:58:47.655438 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.655265 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-trusted-ca-bundle\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:58:47.655438 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.655277 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-oauth-serving-cert\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:58:47.655438 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:47.655288 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a764364-0279-4011-9897-f059b4ea12ea-service-ca\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 21:58:48.262893 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:48.262865 2580 generic.go:356] "Generic (PLEG): container finished" podID="3a764364-0279-4011-9897-f059b4ea12ea" containerID="cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8" exitCode=0 Jul 16 21:58:48.263306 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:48.262909 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759764b84-4wldh" Jul 16 21:58:48.263306 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:48.262957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759764b84-4wldh" event={"ID":"3a764364-0279-4011-9897-f059b4ea12ea","Type":"ContainerDied","Data":"cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8"} Jul 16 21:58:48.263306 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:48.263016 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759764b84-4wldh" event={"ID":"3a764364-0279-4011-9897-f059b4ea12ea","Type":"ContainerDied","Data":"2b97f55ea88c47d5599a5befde05fd993501099764cb56d8dfe9e2d45b031202"} Jul 16 21:58:48.263306 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:48.263045 2580 scope.go:117] "RemoveContainer" containerID="cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8" Jul 16 21:58:48.270485 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:48.270470 2580 scope.go:117] "RemoveContainer" containerID="cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8" Jul 16 21:58:48.270743 ip-10-0-139-247 kubenswrapper[2580]: E0716 21:58:48.270726 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8\": container with ID starting with cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8 not found: ID does not exist" containerID="cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8" Jul 16 21:58:48.270815 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:48.270749 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8"} err="failed to get container status \"cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8\": rpc error: code = NotFound desc = could not find container \"cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8\": container with ID starting with cc0f07d49b2321bd189bdd63cfcd4817021f19d807a0e29908299acbaa7338c8 not found: ID does not exist" Jul 16 21:58:48.285016 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:48.284994 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759764b84-4wldh"] Jul 16 21:58:48.289818 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:48.289799 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-759764b84-4wldh"] Jul 16 21:58:50.235338 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:58:50.235298 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a764364-0279-4011-9897-f059b4ea12ea" path="/var/lib/kubelet/pods/3a764364-0279-4011-9897-f059b4ea12ea/volumes" Jul 16 21:59:10.701463 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.701431 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-8ks9m"] Jul 16 21:59:10.701938 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.701703 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a764364-0279-4011-9897-f059b4ea12ea" containerName="console" Jul 16 21:59:10.701938 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.701727 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a764364-0279-4011-9897-f059b4ea12ea" containerName="console" Jul 16 21:59:10.701938 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.701774 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a764364-0279-4011-9897-f059b4ea12ea" containerName="console" Jul 16 21:59:10.704227 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.704212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8ks9m" Jul 16 21:59:10.707130 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.707108 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 16 21:59:10.707247 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.707158 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 16 21:59:10.707247 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.707200 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mqknh\"" Jul 16 21:59:10.707247 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.707202 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 16 21:59:10.714635 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.714611 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-8ks9m"] Jul 16 21:59:10.820541 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.820519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9dxx\" (UniqueName: \"kubernetes.io/projected/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-kube-api-access-s9dxx\") pod \"s3-init-8ks9m\" (UID: \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\") " pod="kserve/s3-init-8ks9m" Jul 16 21:59:10.820644 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.820571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-model-cache\") pod \"s3-init-8ks9m\" (UID: \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\") " pod="kserve/s3-init-8ks9m" Jul 16 21:59:10.921630 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.921598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-model-cache\") pod \"s3-init-8ks9m\" (UID: \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\") " pod="kserve/s3-init-8ks9m" Jul 16 21:59:10.921782 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.921664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9dxx\" (UniqueName: \"kubernetes.io/projected/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-kube-api-access-s9dxx\") pod \"s3-init-8ks9m\" (UID: \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\") " pod="kserve/s3-init-8ks9m" Jul 16 21:59:10.922018 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.921995 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-model-cache\") pod \"s3-init-8ks9m\" (UID: \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\") " pod="kserve/s3-init-8ks9m" Jul 16 21:59:10.931380 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:10.931354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9dxx\" (UniqueName: \"kubernetes.io/projected/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-kube-api-access-s9dxx\") pod \"s3-init-8ks9m\" (UID: \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\") " pod="kserve/s3-init-8ks9m" Jul 16 21:59:11.032430 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:11.032406 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8ks9m" Jul 16 21:59:11.168559 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:11.168534 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-8ks9m"] Jul 16 21:59:11.170599 ip-10-0-139-247 kubenswrapper[2580]: W0716 21:59:11.170570 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf97e026c_5df7_4dde_92d9_3bbbe4b8929b.slice/crio-42f1eeb59bc9292056434a9d0998f23e07d9f357d4b402d0c90312c42f983e64 WatchSource:0}: Error finding container 42f1eeb59bc9292056434a9d0998f23e07d9f357d4b402d0c90312c42f983e64: Status 404 returned error can't find the container with id 42f1eeb59bc9292056434a9d0998f23e07d9f357d4b402d0c90312c42f983e64 Jul 16 21:59:11.172463 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:11.172446 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 21:59:11.353173 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:11.353112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8ks9m" event={"ID":"f97e026c-5df7-4dde-92d9-3bbbe4b8929b","Type":"ContainerStarted","Data":"42f1eeb59bc9292056434a9d0998f23e07d9f357d4b402d0c90312c42f983e64"} Jul 16 21:59:15.377054 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:15.377016 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8ks9m" event={"ID":"f97e026c-5df7-4dde-92d9-3bbbe4b8929b","Type":"ContainerStarted","Data":"1b5d9d66de1438a8b31a3ed84ebf2294dd5308a447b23f8e851ab934e6bb8b5f"} Jul 16 21:59:16.381271 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:16.381234 2580 generic.go:356] "Generic (PLEG): container finished" podID="f97e026c-5df7-4dde-92d9-3bbbe4b8929b" containerID="1b5d9d66de1438a8b31a3ed84ebf2294dd5308a447b23f8e851ab934e6bb8b5f" exitCode=0 Jul 16 21:59:16.381651 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:16.381319 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8ks9m" event={"ID":"f97e026c-5df7-4dde-92d9-3bbbe4b8929b","Type":"ContainerDied","Data":"1b5d9d66de1438a8b31a3ed84ebf2294dd5308a447b23f8e851ab934e6bb8b5f"} Jul 16 21:59:20.587434 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:20.587411 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 16 21:59:21.403762 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:21.403731 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8ks9m" event={"ID":"f97e026c-5df7-4dde-92d9-3bbbe4b8929b","Type":"ContainerStarted","Data":"61f13e65c475ba3827e68741cfec26adb8f26fe6449705b569502a2f7912c085"} Jul 16 21:59:21.423291 ip-10-0-139-247 kubenswrapper[2580]: I0716 21:59:21.423239 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-8ks9m" podStartSLOduration=2.306922627 podStartE2EDuration="11.423224716s" totalImagesPullingTime="7.885525023s" totalInitContainerRuntime="1.230777066s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:59:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:59:21.422852091 +0000 UTC m=+549.724220395" watchObservedRunningTime="2026-07-16 21:59:21.423224716 +0000 UTC m=+549.724593019" Jul 16 22:00:12.101083 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:12.101058 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 22:00:12.108496 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:12.108472 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 22:00:25.644242 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:25.644209 2580 generic.go:356] "Generic (PLEG): container finished" podID="f97e026c-5df7-4dde-92d9-3bbbe4b8929b" containerID="61f13e65c475ba3827e68741cfec26adb8f26fe6449705b569502a2f7912c085" exitCode=0 Jul 16 22:00:25.644618 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:25.644259 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8ks9m" event={"ID":"f97e026c-5df7-4dde-92d9-3bbbe4b8929b","Type":"ContainerDied","Data":"61f13e65c475ba3827e68741cfec26adb8f26fe6449705b569502a2f7912c085"} Jul 16 22:00:26.766526 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:26.766499 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8ks9m" Jul 16 22:00:26.882939 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:26.882900 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9dxx\" (UniqueName: \"kubernetes.io/projected/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-kube-api-access-s9dxx\") pod \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\" (UID: \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\") " Jul 16 22:00:26.882939 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:26.882944 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-model-cache\") pod \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\" (UID: \"f97e026c-5df7-4dde-92d9-3bbbe4b8929b\") " Jul 16 22:00:26.885109 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:26.885071 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-kube-api-access-s9dxx" (OuterVolumeSpecName: "kube-api-access-s9dxx") pod "f97e026c-5df7-4dde-92d9-3bbbe4b8929b" (UID: "f97e026c-5df7-4dde-92d9-3bbbe4b8929b"). InnerVolumeSpecName "kube-api-access-s9dxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:00:26.900817 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:26.900700 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-model-cache" (OuterVolumeSpecName: "model-cache") pod "f97e026c-5df7-4dde-92d9-3bbbe4b8929b" (UID: "f97e026c-5df7-4dde-92d9-3bbbe4b8929b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:00:26.984069 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:26.984044 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9dxx\" (UniqueName: \"kubernetes.io/projected/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-kube-api-access-s9dxx\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 22:00:26.984069 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:26.984066 2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f97e026c-5df7-4dde-92d9-3bbbe4b8929b-model-cache\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 22:00:27.653389 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:27.653361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8ks9m" event={"ID":"f97e026c-5df7-4dde-92d9-3bbbe4b8929b","Type":"ContainerDied","Data":"42f1eeb59bc9292056434a9d0998f23e07d9f357d4b402d0c90312c42f983e64"} Jul 16 22:00:27.653389 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:27.653388 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8ks9m" Jul 16 22:00:27.653574 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:00:27.653397 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42f1eeb59bc9292056434a9d0998f23e07d9f357d4b402d0c90312c42f983e64" Jul 16 22:05:12.125516 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:05:12.125482 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 22:05:12.129792 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:05:12.129766 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 22:10:12.148883 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:10:12.148841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 22:10:12.153782 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:10:12.153757 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 22:15:12.172375 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:15:12.172346 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 22:15:12.174583 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:15:12.174560 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 22:16:02.475002 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.474969 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b5d89/must-gather-t6cmt"] Jul 16 22:16:02.475379 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.475228 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f97e026c-5df7-4dde-92d9-3bbbe4b8929b" containerName="download-hf-model" Jul 16 22:16:02.475379 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.475239 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f97e026c-5df7-4dde-92d9-3bbbe4b8929b" containerName="download-hf-model" Jul 16 22:16:02.475379 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.475248 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f97e026c-5df7-4dde-92d9-3bbbe4b8929b" containerName="s3-init" Jul 16 22:16:02.475379 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.475254 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f97e026c-5df7-4dde-92d9-3bbbe4b8929b" containerName="s3-init" Jul 16 22:16:02.475379 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.475330 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f97e026c-5df7-4dde-92d9-3bbbe4b8929b" containerName="s3-init" Jul 16 22:16:02.478271 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.478250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:02.481237 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.481219 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b5d89\"/\"kube-root-ca.crt\"" Jul 16 22:16:02.482420 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.482400 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b5d89\"/\"openshift-service-ca.crt\"" Jul 16 22:16:02.482530 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.482440 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b5d89\"/\"default-dockercfg-wn5wx\"" Jul 16 22:16:02.490683 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.490660 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b5d89/must-gather-t6cmt"] Jul 16 22:16:02.588670 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.588646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d723407-535f-42c1-8f61-c64ee0225bc9-must-gather-output\") pod \"must-gather-t6cmt\" (UID: \"4d723407-535f-42c1-8f61-c64ee0225bc9\") " pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:02.588795 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.588673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzbz7\" (UniqueName: \"kubernetes.io/projected/4d723407-535f-42c1-8f61-c64ee0225bc9-kube-api-access-lzbz7\") pod \"must-gather-t6cmt\" (UID: \"4d723407-535f-42c1-8f61-c64ee0225bc9\") " pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:02.689499 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.689476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d723407-535f-42c1-8f61-c64ee0225bc9-must-gather-output\") pod \"must-gather-t6cmt\" (UID: \"4d723407-535f-42c1-8f61-c64ee0225bc9\") " pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:02.689585 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.689501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzbz7\" (UniqueName: \"kubernetes.io/projected/4d723407-535f-42c1-8f61-c64ee0225bc9-kube-api-access-lzbz7\") pod \"must-gather-t6cmt\" (UID: \"4d723407-535f-42c1-8f61-c64ee0225bc9\") " pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:02.689801 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.689786 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d723407-535f-42c1-8f61-c64ee0225bc9-must-gather-output\") pod \"must-gather-t6cmt\" (UID: \"4d723407-535f-42c1-8f61-c64ee0225bc9\") " pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:02.697163 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.697146 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzbz7\" (UniqueName: \"kubernetes.io/projected/4d723407-535f-42c1-8f61-c64ee0225bc9-kube-api-access-lzbz7\") pod \"must-gather-t6cmt\" (UID: \"4d723407-535f-42c1-8f61-c64ee0225bc9\") " pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:02.796886 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.796821 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:02.919510 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.919490 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b5d89/must-gather-t6cmt"] Jul 16 22:16:02.922055 ip-10-0-139-247 kubenswrapper[2580]: W0716 22:16:02.922027 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d723407_535f_42c1_8f61_c64ee0225bc9.slice/crio-1fc2f23d900ebddef8c483e84326409c3f7eee1b14d0444e8abddca6b81a3e33 WatchSource:0}: Error finding container 1fc2f23d900ebddef8c483e84326409c3f7eee1b14d0444e8abddca6b81a3e33: Status 404 returned error can't find the container with id 1fc2f23d900ebddef8c483e84326409c3f7eee1b14d0444e8abddca6b81a3e33 Jul 16 22:16:02.923823 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:02.923807 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 22:16:03.071351 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:03.071293 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b5d89/must-gather-t6cmt" event={"ID":"4d723407-535f-42c1-8f61-c64ee0225bc9","Type":"ContainerStarted","Data":"1fc2f23d900ebddef8c483e84326409c3f7eee1b14d0444e8abddca6b81a3e33"} Jul 16 22:16:10.104770 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:10.104735 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b5d89/must-gather-t6cmt" event={"ID":"4d723407-535f-42c1-8f61-c64ee0225bc9","Type":"ContainerStarted","Data":"f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13"} Jul 16 22:16:10.104770 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:10.104775 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b5d89/must-gather-t6cmt" event={"ID":"4d723407-535f-42c1-8f61-c64ee0225bc9","Type":"ContainerStarted","Data":"95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1"} Jul 16 22:16:10.124008 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:10.123963 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b5d89/must-gather-t6cmt" podStartSLOduration=1.975841361 podStartE2EDuration="8.123949504s" totalImagesPullingTime="6.148108143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:16:10.123099923 +0000 UTC m=+1558.424468229" watchObservedRunningTime="2026-07-16 22:16:10.123949504 +0000 UTC m=+1558.425317808" Jul 16 22:16:28.180146 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:28.180111 2580 generic.go:356] "Generic (PLEG): container finished" podID="4d723407-535f-42c1-8f61-c64ee0225bc9" containerID="95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1" exitCode=0 Jul 16 22:16:28.180534 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:28.180157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b5d89/must-gather-t6cmt" event={"ID":"4d723407-535f-42c1-8f61-c64ee0225bc9","Type":"ContainerDied","Data":"95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1"} Jul 16 22:16:28.180534 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:28.180448 2580 scope.go:117] "RemoveContainer" containerID="95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1" Jul 16 22:16:28.429176 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:28.429145 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b5d89_must-gather-t6cmt_4d723407-535f-42c1-8f61-c64ee0225bc9/gather/0.log" Jul 16 22:16:31.953224 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:31.950873 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5s4f7_98445a28-5caa-4485-9a1f-a0c7ee0ae943/global-pull-secret-syncer/0.log" Jul 16 22:16:32.131588 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:32.131558 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8hrxs_bc6128de-8fec-4aaf-883b-17d7ce474171/konnectivity-agent/0.log" Jul 16 22:16:32.243178 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:32.243148 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-247.ec2.internal_f7940344e37b0417b90f8d2a19bc8556/haproxy/0.log" Jul 16 22:16:33.838762 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:33.838705 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-b5d89/must-gather-t6cmt"] Jul 16 22:16:33.839227 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:33.838901 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-b5d89/must-gather-t6cmt" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" containerName="copy" containerID="cri-o://f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13" gracePeriod=2 Jul 16 22:16:33.843536 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:33.842862 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-b5d89/must-gather-t6cmt"] Jul 16 22:16:34.067349 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.067327 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b5d89_must-gather-t6cmt_4d723407-535f-42c1-8f61-c64ee0225bc9/copy/0.log" Jul 16 22:16:34.069333 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.069312 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:34.071623 ip-10-0-139-247 kubenswrapper[2580]: E0716 22:16:34.071597 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-t6cmt\" is forbidden: User \"system:node:ip-10-0-139-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b5d89\": no relationship found between node 'ip-10-0-139-247.ec2.internal' and this object" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:34.157103 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.157024 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d723407-535f-42c1-8f61-c64ee0225bc9-must-gather-output\") pod \"4d723407-535f-42c1-8f61-c64ee0225bc9\" (UID: \"4d723407-535f-42c1-8f61-c64ee0225bc9\") " Jul 16 22:16:34.157225 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.157133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzbz7\" (UniqueName: \"kubernetes.io/projected/4d723407-535f-42c1-8f61-c64ee0225bc9-kube-api-access-lzbz7\") pod \"4d723407-535f-42c1-8f61-c64ee0225bc9\" (UID: \"4d723407-535f-42c1-8f61-c64ee0225bc9\") " Jul 16 22:16:34.158221 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.158189 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d723407-535f-42c1-8f61-c64ee0225bc9-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "4d723407-535f-42c1-8f61-c64ee0225bc9" (UID: "4d723407-535f-42c1-8f61-c64ee0225bc9"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 22:16:34.159289 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.159266 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d723407-535f-42c1-8f61-c64ee0225bc9-kube-api-access-lzbz7" (OuterVolumeSpecName: "kube-api-access-lzbz7") pod "4d723407-535f-42c1-8f61-c64ee0225bc9" (UID: "4d723407-535f-42c1-8f61-c64ee0225bc9"). InnerVolumeSpecName "kube-api-access-lzbz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:16:34.202583 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.202555 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b5d89_must-gather-t6cmt_4d723407-535f-42c1-8f61-c64ee0225bc9/copy/0.log" Jul 16 22:16:34.202933 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.202910 2580 generic.go:356] "Generic (PLEG): container finished" podID="4d723407-535f-42c1-8f61-c64ee0225bc9" containerID="f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13" exitCode=143 Jul 16 22:16:34.203033 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.202952 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:34.203033 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.202967 2580 scope.go:117] "RemoveContainer" containerID="f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13" Jul 16 22:16:34.205308 ip-10-0-139-247 kubenswrapper[2580]: E0716 22:16:34.205278 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-t6cmt\" is forbidden: User \"system:node:ip-10-0-139-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b5d89\": no relationship found between node 'ip-10-0-139-247.ec2.internal' and this object" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:34.211087 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.211070 2580 scope.go:117] "RemoveContainer" containerID="95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1" Jul 16 22:16:34.213156 ip-10-0-139-247 kubenswrapper[2580]: E0716 22:16:34.213135 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-t6cmt\" is forbidden: User \"system:node:ip-10-0-139-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b5d89\": no relationship found between node 'ip-10-0-139-247.ec2.internal' and this object" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" pod="openshift-must-gather-b5d89/must-gather-t6cmt" Jul 16 22:16:34.222128 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.222112 2580 scope.go:117] "RemoveContainer" containerID="f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13" Jul 16 22:16:34.222698 ip-10-0-139-247 kubenswrapper[2580]: E0716 22:16:34.222569 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13\": container with ID starting with f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13 not found: ID does not exist" containerID="f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13" Jul 16 22:16:34.222698 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.222615 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13"} err="failed to get container status \"f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13\": rpc error: code = NotFound desc = could not find container \"f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13\": container with ID starting with f6eceea1a59bb8034d1c501839fc29b1cdb1959b661338aaa4e30c6bbc9edb13 not found: ID does not exist" Jul 16 22:16:34.222698 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.222636 2580 scope.go:117] "RemoveContainer" containerID="95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1" Jul 16 22:16:34.223029 ip-10-0-139-247 kubenswrapper[2580]: E0716 22:16:34.222971 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1\": container with ID starting with 95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1 not found: ID does not exist" containerID="95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1" Jul 16 22:16:34.223029 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.222998 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1"} err="failed to get container status \"95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1\": rpc error: code = NotFound desc = could not find container \"95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1\": container with ID starting with 95a0e3ada0255c11599ceff530860d696be63bfcdfcb4061137ea3c1c692d3f1 not found: ID does not exist" Jul 16 22:16:34.234574 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.234548 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" path="/var/lib/kubelet/pods/4d723407-535f-42c1-8f61-c64ee0225bc9/volumes" Jul 16 22:16:34.258589 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.258554 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzbz7\" (UniqueName: \"kubernetes.io/projected/4d723407-535f-42c1-8f61-c64ee0225bc9-kube-api-access-lzbz7\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 22:16:34.258589 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:34.258587 2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4d723407-535f-42c1-8f61-c64ee0225bc9-must-gather-output\") on node \"ip-10-0-139-247.ec2.internal\" DevicePath \"\"" Jul 16 22:16:36.939332 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:36.939252 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9cc6d59b9-snrdr_c3804c34-53a9-41d4-8814-41ac6123fc45/metrics-server/0.log" Jul 16 22:16:37.034568 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.034535 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6qljp_e3764158-af2a-420e-ba70-806a535c1635/node-exporter/0.log" Jul 16 22:16:37.072929 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.072898 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6qljp_e3764158-af2a-420e-ba70-806a535c1635/kube-rbac-proxy/0.log" Jul 16 22:16:37.125652 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.125624 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6qljp_e3764158-af2a-420e-ba70-806a535c1635/init-textfile/0.log" Jul 16 22:16:37.468377 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.468348 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-pfzjq_ca67f2f9-44cc-4f01-81e1-79471f090ccb/kube-rbac-proxy-main/0.log" Jul 16 22:16:37.497143 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.497115 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-pfzjq_ca67f2f9-44cc-4f01-81e1-79471f090ccb/kube-rbac-proxy-self/0.log" Jul 16 22:16:37.528972 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.528946 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-pfzjq_ca67f2f9-44cc-4f01-81e1-79471f090ccb/openshift-state-metrics/0.log" Jul 16 22:16:37.584653 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.584628 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2e5708fd-f730-40e9-8b4f-c941453444fc/prometheus/0.log" Jul 16 22:16:37.627979 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.627902 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2e5708fd-f730-40e9-8b4f-c941453444fc/config-reloader/0.log" Jul 16 22:16:37.670918 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.670888 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2e5708fd-f730-40e9-8b4f-c941453444fc/thanos-sidecar/0.log" Jul 16 22:16:37.717774 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.717746 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2e5708fd-f730-40e9-8b4f-c941453444fc/kube-rbac-proxy-web/0.log" Jul 16 22:16:37.754561 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.754534 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2e5708fd-f730-40e9-8b4f-c941453444fc/kube-rbac-proxy/0.log" Jul 16 22:16:37.795788 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.795759 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2e5708fd-f730-40e9-8b4f-c941453444fc/kube-rbac-proxy-thanos/0.log" Jul 16 22:16:37.830776 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.830735 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2e5708fd-f730-40e9-8b4f-c941453444fc/init-config-reloader/0.log" Jul 16 22:16:37.973989 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:37.973957 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-gx9kp_2a8122a2-f750-4448-be0c-be9421edbba2/prometheus-operator-admission-webhook/0.log" Jul 16 22:16:39.272107 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.272083 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-tndd5_9bd91568-aff6-4ce0-b8af-e81ab9688148/networking-console-plugin/0.log" Jul 16 22:16:39.506378 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.506341 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st"] Jul 16 22:16:39.506643 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.506631 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" containerName="gather" Jul 16 22:16:39.506685 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.506645 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" containerName="gather" Jul 16 22:16:39.506685 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.506658 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" containerName="copy" Jul 16 22:16:39.506685 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.506663 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" containerName="copy" Jul 16 22:16:39.506803 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.506736 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" containerName="copy" Jul 16 22:16:39.506803 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.506746 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d723407-535f-42c1-8f61-c64ee0225bc9" containerName="gather" Jul 16 22:16:39.510327 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.510302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.514267 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.514246 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k8wws\"/\"default-dockercfg-nqlp4\"" Jul 16 22:16:39.515498 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.515470 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k8wws\"/\"kube-root-ca.crt\"" Jul 16 22:16:39.515603 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.515505 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k8wws\"/\"openshift-service-ca.crt\"" Jul 16 22:16:39.522960 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.522893 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st"] Jul 16 22:16:39.602463 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.602426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-proc\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.602463 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.602471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-sys\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.602667 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.602506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-lib-modules\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.602667 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.602548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-podres\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.602667 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.602590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7k4j\" (UniqueName: \"kubernetes.io/projected/d4feb622-124d-48c4-bf19-db678ec823be-kube-api-access-w7k4j\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.703943 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.703906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-lib-modules\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.704083 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.703956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-podres\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.704083 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.703993 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7k4j\" (UniqueName: \"kubernetes.io/projected/d4feb622-124d-48c4-bf19-db678ec823be-kube-api-access-w7k4j\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.704083 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.704021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-proc\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.704083 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.704040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-sys\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.704221 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.704088 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-lib-modules\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.704221 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.704122 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-proc\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.704221 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.704135 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-sys\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.704221 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.704159 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4feb622-124d-48c4-bf19-db678ec823be-podres\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.717855 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.717828 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7k4j\" (UniqueName: \"kubernetes.io/projected/d4feb622-124d-48c4-bf19-db678ec823be-kube-api-access-w7k4j\") pod \"perf-node-gather-daemonset-ns8st\" (UID: \"d4feb622-124d-48c4-bf19-db678ec823be\") " pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.819735 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.819625 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:39.951480 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:39.951442 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st"] Jul 16 22:16:39.954515 ip-10-0-139-247 kubenswrapper[2580]: W0716 22:16:39.954487 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd4feb622_124d_48c4_bf19_db678ec823be.slice/crio-053c28b43e3af04c169ed5a4cc8a862a1a54c137cf7de6c65466fe2e7d3495d4 WatchSource:0}: Error finding container 053c28b43e3af04c169ed5a4cc8a862a1a54c137cf7de6c65466fe2e7d3495d4: Status 404 returned error can't find the container with id 053c28b43e3af04c169ed5a4cc8a862a1a54c137cf7de6c65466fe2e7d3495d4 Jul 16 22:16:40.227292 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:40.227255 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" event={"ID":"d4feb622-124d-48c4-bf19-db678ec823be","Type":"ContainerStarted","Data":"0ab22568bd4c60b0332e86a78a43f844adbbe730857c19c4f7f1e13d63e6b44c"} Jul 16 22:16:40.227452 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:40.227312 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" event={"ID":"d4feb622-124d-48c4-bf19-db678ec823be","Type":"ContainerStarted","Data":"053c28b43e3af04c169ed5a4cc8a862a1a54c137cf7de6c65466fe2e7d3495d4"} Jul 16 22:16:40.227452 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:40.227334 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:40.235019 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:40.234980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-677957b8f4-b844p_e0b95e5c-8ba6-4434-b99d-731f2d76d943/console/0.log" Jul 16 22:16:40.246295 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:40.246251 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" podStartSLOduration=1.246236849 podStartE2EDuration="1.246236849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:16:40.245822178 +0000 UTC m=+1588.547190483" watchObservedRunningTime="2026-07-16 22:16:40.246236849 +0000 UTC m=+1588.547605153" Jul 16 22:16:40.265036 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:40.265012 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-knpdb_5badf17d-5121-451a-97d9-39922c618279/download-server/0.log" Jul 16 22:16:41.777099 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:41.777074 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rssrk_697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c/dns/0.log" Jul 16 22:16:41.804332 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:41.800275 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rssrk_697f9fb7-fcfb-4f6d-9b57-c38d3bd8d36c/kube-rbac-proxy/0.log" Jul 16 22:16:41.825679 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:41.825652 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7rfmd_21833623-82fa-42d0-9f6f-24fc6fd8a79b/dns-node-resolver/0.log" Jul 16 22:16:42.327849 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:42.327820 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67b5dfb4-nrrfh_ed9e0494-166d-4611-a2d7-243f9419b222/registry/0.log" Jul 16 22:16:42.375109 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:42.375080 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8zcdj_18f81724-7fd6-40fd-a874-deae8fac08b0/node-ca/0.log" Jul 16 22:16:43.440919 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:43.440890 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-68xvq_f11aa9c9-ff28-4085-b6ed-2fa149846ee7/serve-healthcheck-canary/0.log" Jul 16 22:16:43.939892 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:43.939864 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dmh8v_f80f4253-98c1-4664-8ea2-174537979a2d/kube-rbac-proxy/0.log" Jul 16 22:16:43.962312 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:43.962280 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dmh8v_f80f4253-98c1-4664-8ea2-174537979a2d/exporter/0.log" Jul 16 22:16:43.984621 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:43.984586 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dmh8v_f80f4253-98c1-4664-8ea2-174537979a2d/extractor/0.log" Jul 16 22:16:46.240469 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:46.240438 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k8wws/perf-node-gather-daemonset-ns8st" Jul 16 22:16:46.406055 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:46.406015 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-8ks9m_f97e026c-5df7-4dde-92d9-3bbbe4b8929b/s3-init/0.log" Jul 16 22:16:46.421719 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:46.421695 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-8ks9m_f97e026c-5df7-4dde-92d9-3bbbe4b8929b/download-hf-model/0.log" Jul 16 22:16:50.841878 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:50.841853 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-r4k7f_8dc6907a-8be0-4251-bada-6e89c4c81ef8/migrator/0.log" Jul 16 22:16:50.870523 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:50.870500 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-r4k7f_8dc6907a-8be0-4251-bada-6e89c4c81ef8/graceful-termination/0.log" Jul 16 22:16:52.188758 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.188732 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsp4_0b2139b2-a6a2-4bd1-81df-140cb9725bec/kube-multus-additional-cni-plugins/0.log" Jul 16 22:16:52.214668 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.214641 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsp4_0b2139b2-a6a2-4bd1-81df-140cb9725bec/egress-router-binary-copy/0.log" Jul 16 22:16:52.260236 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.260206 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsp4_0b2139b2-a6a2-4bd1-81df-140cb9725bec/cni-plugins/0.log" Jul 16 22:16:52.287616 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.287586 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsp4_0b2139b2-a6a2-4bd1-81df-140cb9725bec/bond-cni-plugin/0.log" Jul 16 22:16:52.311874 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.311841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsp4_0b2139b2-a6a2-4bd1-81df-140cb9725bec/routeoverride-cni/0.log" Jul 16 22:16:52.348199 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.348168 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsp4_0b2139b2-a6a2-4bd1-81df-140cb9725bec/whereabouts-cni-bincopy/0.log" Jul 16 22:16:52.370964 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.370938 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsp4_0b2139b2-a6a2-4bd1-81df-140cb9725bec/whereabouts-cni/0.log" Jul 16 22:16:52.742829 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.742800 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t74t6_7a0287d5-e389-4834-a1ac-afb4a4eb9e20/kube-multus/0.log" Jul 16 22:16:52.763764 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.763736 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-46cth_7e4b8d92-3a02-482d-bc1f-61e537dd7409/network-metrics-daemon/0.log" Jul 16 22:16:52.785331 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:52.785301 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-46cth_7e4b8d92-3a02-482d-bc1f-61e537dd7409/kube-rbac-proxy/0.log" Jul 16 22:16:53.608746 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:53.608720 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-controller/0.log" Jul 16 22:16:53.628752 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:53.628722 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/1.log" Jul 16 22:16:53.628752 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:53.628732 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovn-acl-logging/0.log" Jul 16 22:16:53.646633 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:53.646608 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/kube-rbac-proxy-node/0.log" Jul 16 22:16:53.668153 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:53.668128 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 22:16:53.690413 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:53.690392 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/northd/0.log" Jul 16 22:16:53.711342 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:53.711320 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/nbdb/0.log" Jul 16 22:16:53.733237 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:53.733217 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/sbdb/0.log" Jul 16 22:16:53.770928 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:53.770908 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-24qjh_cc9d6663-81ba-4b35-a262-48204ba79d29/ovnkube-controller/0.log" Jul 16 22:16:55.233231 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:55.233196 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dqmwr_04e0efc9-aef4-409d-b03c-d67ea93a95ad/network-check-target-container/0.log" Jul 16 22:16:56.239875 ip-10-0-139-247 kubenswrapper[2580]: I0716 22:16:56.239851 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6rsqs_39c905d9-86aa-4365-a416-7512750c564b/iptables-alerter/0.log"