Jul 20 04:38:12.963799 ip-10-0-139-1 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 04:38:12.963811 ip-10-0-139-1 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 04:38:12.963818 ip-10-0-139-1 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 04:38:12.964089 ip-10-0-139-1 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 04:38:23.093779 ip-10-0-139-1 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 04:38:23.093799 ip-10-0-139-1 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1ace3640c781446e9580073fd3583894 -- Jul 20 04:39:58.045624 ip-10-0-139-1 systemd[1]: Starting Kubernetes Kubelet... Jul 20 04:39:58.477734 ip-10-0-139-1 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 04:39:58.477734 ip-10-0-139-1 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 04:39:58.477734 ip-10-0-139-1 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 04:39:58.477734 ip-10-0-139-1 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 04:39:58.477734 ip-10-0-139-1 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 04:39:58.479852 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.479760 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 04:39:58.488393 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488373 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 04:39:58.488393 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488390 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 04:39:58.488393 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488394 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488397 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488400 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488404 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488407 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488409 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488412 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488414 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488417 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488420 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488422 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488425 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488427 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488430 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488433 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488436 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488444 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488447 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488451 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 04:39:58.488494 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488455 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488458 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488461 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488464 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488467 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488470 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488473 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488475 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488478 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488481 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488483 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488486 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488488 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488490 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488493 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488497 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488499 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488502 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488506 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488508 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 04:39:58.488977 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488512 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488515 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488518 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488521 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488524 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488527 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488529 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488532 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488534 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488537 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488540 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488542 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488544 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488547 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488549 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488552 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488554 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488556 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488559 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 04:39:58.489517 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488562 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488564 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488566 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488569 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488571 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488574 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488576 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488579 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488582 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488585 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488588 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488592 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488596 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488598 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488601 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488604 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488606 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488609 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488611 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 04:39:58.490018 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488614 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488616 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488619 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488621 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488624 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488627 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488629 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488632 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488634 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488637 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488639 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488641 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488644 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488647 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488650 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488652 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488655 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488657 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488660 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.488663 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 04:39:58.490565 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489392 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489399 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489402 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489404 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489408 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489411 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489413 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489416 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489419 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489421 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489424 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489426 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489429 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489432 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489436 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489438 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489441 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489444 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489447 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489449 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 04:39:58.491099 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489452 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489455 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489457 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489459 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489462 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489465 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489468 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489470 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489473 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489478 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489482 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489485 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489488 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489491 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489493 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489496 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489499 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489501 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489504 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489506 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 04:39:58.491646 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489508 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489511 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489514 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489516 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489521 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489525 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489528 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489531 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489533 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489536 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489538 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489541 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489544 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489547 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489549 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489552 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489555 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489558 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489561 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 04:39:58.492170 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489563 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489566 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489569 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489572 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489575 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489577 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489580 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489582 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489585 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489587 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489591 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489593 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489595 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489598 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489600 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489603 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489605 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489608 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489610 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489612 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 04:39:58.492687 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489615 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489617 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489620 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489622 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489625 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489628 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489631 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489633 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489635 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489638 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489641 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489643 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489646 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489648 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489651 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489653 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489656 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489658 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489661 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 04:39:58.493212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.489663 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490063 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490069 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490073 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490076 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490079 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490082 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490084 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490087 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490090 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490093 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490096 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490099 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490101 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490104 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490107 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490110 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490113 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490116 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 04:39:58.493723 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490119 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490121 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490124 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490127 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490129 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490132 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490134 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490138 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490140 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490143 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490145 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490148 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490152 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490155 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490158 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490160 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490163 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490165 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490167 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490170 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 04:39:58.494225 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490172 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490175 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490177 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490180 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490182 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490184 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490187 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490189 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490191 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490194 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490196 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490199 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490202 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490204 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490206 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490209 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490211 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490214 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490216 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 04:39:58.494780 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490219 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490222 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490224 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490227 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490229 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490232 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490234 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490236 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490239 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490241 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490243 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490246 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490248 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490251 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490253 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490255 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490258 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490260 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490263 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490266 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 04:39:58.495354 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490268 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490271 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490273 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490275 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490277 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490280 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490284 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490287 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490290 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490293 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490295 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490298 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490300 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490324 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490328 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490332 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490336 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490340 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490343 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490348 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 04:39:58.495963 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490351 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.490353 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490431 2553 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490438 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490444 2553 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490451 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490457 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490462 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490468 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490473 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490476 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490479 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490483 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490486 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490489 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490492 2553 flags.go:64] FLAG: --cgroup-root="" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490494 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490497 2553 flags.go:64] FLAG: --client-ca-file="" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490500 2553 flags.go:64] FLAG: --cloud-provider="external" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490503 2553 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490515 2553 flags.go:64] FLAG: --cluster-domain="" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490518 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490521 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 04:39:58.496510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490524 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490528 2553 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490538 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490541 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490544 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490547 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490550 2553 flags.go:64] FLAG: --contention-profiling="false" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490553 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490556 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490559 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490561 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490565 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490568 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490571 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490574 2553 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490577 2553 flags.go:64] FLAG: --enable-server="true" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490580 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490584 2553 flags.go:64] FLAG: --event-burst="100" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490587 2553 flags.go:64] FLAG: --event-qps="50" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490590 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490595 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490598 2553 flags.go:64] FLAG: --eviction-hard="" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490601 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490604 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490607 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 04:39:58.497117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490610 2553 flags.go:64] FLAG: --eviction-soft="" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490613 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490616 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490619 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490625 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490628 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490631 2553 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490633 2553 flags.go:64] FLAG: --feature-gates="" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490641 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490645 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490648 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490651 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490654 2553 flags.go:64] FLAG: --healthz-port="10248" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490657 2553 flags.go:64] FLAG: --help="false" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490659 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490662 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490665 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490668 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490671 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490674 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490677 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490680 2553 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490682 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 04:39:58.497801 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490685 2553 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490688 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490691 2553 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490693 2553 flags.go:64] FLAG: --kube-reserved="" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490698 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490700 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490703 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490706 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490709 2553 flags.go:64] FLAG: --lock-file="" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490711 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490714 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490717 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490722 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490725 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490728 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490731 2553 flags.go:64] FLAG: --logging-format="text" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490733 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490737 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490748 2553 flags.go:64] FLAG: --manifest-url="" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490751 2553 flags.go:64] FLAG: --manifest-url-header="" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490756 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490759 2553 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490763 2553 flags.go:64] FLAG: --max-pods="110" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490766 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490769 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 04:39:58.498454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490771 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490774 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490777 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490780 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490782 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490790 2553 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490792 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490795 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490798 2553 flags.go:64] FLAG: --pod-cidr="" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490801 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490807 2553 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490811 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490815 2553 flags.go:64] FLAG: --pods-per-core="0" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490817 2553 flags.go:64] FLAG: --port="10250" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490820 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490823 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c41e4e2183bcffda" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490826 2553 flags.go:64] FLAG: --qos-reserved="" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490829 2553 flags.go:64] FLAG: --read-only-port="10255" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490831 2553 flags.go:64] FLAG: --register-node="true" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490834 2553 flags.go:64] FLAG: --register-with-taints="" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490837 2553 flags.go:64] FLAG: --registry-burst="10" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490840 2553 flags.go:64] FLAG: --registry-qps="5" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490843 2553 flags.go:64] FLAG: --reserved-cpus="" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490846 2553 flags.go:64] FLAG: --reserved-memory="" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490849 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 04:39:58.499210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490853 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490856 2553 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490859 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490862 2553 flags.go:64] FLAG: --runonce="false" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490864 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490867 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490870 2553 flags.go:64] FLAG: --seccomp-default="false" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490872 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490875 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490878 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490880 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490883 2553 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490886 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490889 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490891 2553 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490894 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490897 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490900 2553 flags.go:64] FLAG: --system-cgroups="" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490904 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490909 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490912 2553 flags.go:64] FLAG: --tls-cert-file="" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490914 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490918 2553 flags.go:64] FLAG: --tls-min-version="" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490921 2553 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490924 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 04:39:58.500258 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490926 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490929 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490932 2553 flags.go:64] FLAG: --v="2" Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490935 2553 flags.go:64] FLAG: --version="false" Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490939 2553 flags.go:64] FLAG: --vmodule="" Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490944 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.490947 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491066 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491070 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491073 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491076 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491079 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491082 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491084 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491087 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491089 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491092 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491094 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491097 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491099 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491102 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 04:39:58.501025 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491105 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491107 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491110 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491113 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491116 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491119 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491121 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491124 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491126 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491128 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491131 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491133 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491136 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491138 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491141 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491144 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491146 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491149 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491152 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491155 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 04:39:58.501602 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491158 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491160 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491163 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491165 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491168 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491170 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491173 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491175 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491177 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491180 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491182 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491185 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491187 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491190 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491192 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491195 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491200 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491204 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491206 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491209 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 04:39:58.502131 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491211 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491214 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491216 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491218 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491221 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491223 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491225 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491228 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491231 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491233 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491236 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491240 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491242 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491245 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491247 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491250 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491252 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491255 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491257 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491259 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 04:39:58.502671 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491262 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491264 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491267 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491269 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491272 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491274 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491277 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491279 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491283 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491286 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491288 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491291 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491293 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491296 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491298 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491301 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491320 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491326 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491331 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491336 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 04:39:58.503208 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491339 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491343 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491346 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491351 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.491354 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.492162 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.501215 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.501234 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.501254 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.501260 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501345 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501351 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501354 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501357 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 04:39:58.503748 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501361 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501363 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501366 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501369 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501371 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501374 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501376 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501379 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501382 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501385 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501390 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501394 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501397 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501400 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501402 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501407 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501410 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501414 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501417 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 04:39:58.504128 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501420 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501422 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501425 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501428 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501431 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501433 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501437 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501440 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501443 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501446 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501448 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501451 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501454 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501456 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501459 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501461 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501464 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501466 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501468 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501471 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 04:39:58.504697 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501473 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501476 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501478 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501483 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501486 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501489 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501492 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501495 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501497 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501499 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501502 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501504 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501507 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501509 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501511 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501514 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501516 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501518 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501521 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 04:39:58.505228 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501524 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501527 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501529 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501532 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501534 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501537 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501539 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501541 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501544 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501546 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501548 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501551 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501554 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501556 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501558 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501561 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501563 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501567 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501570 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501572 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 04:39:58.505750 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501574 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501577 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501579 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501582 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501584 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501587 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501589 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501591 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501594 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501596 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501599 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501602 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501604 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501607 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501610 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501612 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 04:39:58.506266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501615 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.501620 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501747 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501752 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501756 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501759 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501762 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501764 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501767 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501770 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501772 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501775 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501777 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501779 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501783 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 04:39:58.506692 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501785 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501789 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501793 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501796 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501798 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501800 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501803 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501805 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501808 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501810 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501813 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501815 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501818 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501821 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501823 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501825 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501828 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501830 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501833 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501835 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 04:39:58.507090 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501837 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501840 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501842 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501845 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501847 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501849 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501852 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501854 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501857 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501859 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501861 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501863 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501866 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501869 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501872 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501874 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501877 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501879 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501881 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501884 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 04:39:58.507713 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501886 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501888 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501891 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501893 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501896 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501899 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501901 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501903 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501906 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501909 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501911 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501914 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501916 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501918 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501921 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501923 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501926 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501928 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501930 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501933 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 04:39:58.508233 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501935 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501938 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501940 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501942 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501945 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501948 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501950 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501953 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501955 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501958 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501960 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501963 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501965 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501967 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501970 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501972 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501975 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501977 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501981 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 04:39:58.508770 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501985 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501988 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501991 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501994 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501996 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.501998 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:58.502001 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.502006 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.502129 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.506491 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.508072 2553 server.go:1019] "Starting client certificate rotation" Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.508174 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 04:39:58.509276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.508207 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 04:39:58.511107 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.511094 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 04:39:58.513222 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.513205 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 04:39:58.523855 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.523827 2553 log.go:25] "Validated CRI v1 runtime API" Jul 20 04:39:58.526479 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.526459 2553 log.go:25] "Validated CRI v1 image API" Jul 20 04:39:58.527297 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.527282 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 04:39:58.529925 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.529899 2553 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9aca84c0-d070-4666-a49d-6b903835548b:/dev/nvme0n1p3 a97705c8-27df-4d7b-bc62-3ee05c020693:/dev/nvme0n1p4] Jul 20 04:39:58.530001 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.529923 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 04:39:58.535931 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.535795 2553 manager.go:216] Machine: {Timestamp:2026-07-20 04:39:58.534294514 +0000 UTC m=+0.365624610 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3125079 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec297215453fdadf8bce80f834617a19 SystemUUID:ec297215-453f-dadf-8bce-80f834617a19 BootID:1ace3640-c781-446e-9580-073fd3583894 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:83:af:e2:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:83:af:e2:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:34:d2:82:62:8e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 04:39:58.535931 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.535915 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 04:39:58.536095 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.536012 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 04:39:58.540402 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.540118 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 04:39:58.540597 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.540409 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 04:39:58.540785 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.540768 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 04:39:58.541361 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.541347 2553 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 04:39:58.541422 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.541368 2553 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 04:39:58.541422 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.541380 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 04:39:58.542227 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.542215 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 04:39:58.544030 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.544017 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 04:39:58.549328 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.549296 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 20 04:39:58.549469 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.549457 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 04:39:58.549545 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.549497 2553 kubelet.go:486] "Attempting to sync node with API server" Jul 20 04:39:58.549545 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.549512 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 04:39:58.549545 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.549533 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 04:39:58.549672 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.549548 2553 kubelet.go:398] "Adding apiserver pod source" Jul 20 04:39:58.549672 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.549561 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 04:39:58.549978 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.549964 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 04:39:58.550044 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.549990 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 04:39:58.554617 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.554598 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d586l" Jul 20 04:39:58.556391 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.556378 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 04:39:58.558810 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.558795 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 04:39:58.558898 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.558827 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 04:39:58.560335 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560321 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 04:39:58.560389 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560341 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 04:39:58.560389 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560349 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 04:39:58.560389 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560355 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 04:39:58.560389 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560364 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 04:39:58.560389 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560370 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 04:39:58.560389 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560378 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 04:39:58.560389 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560383 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 04:39:58.560389 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560390 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 04:39:58.560683 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560395 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 04:39:58.560683 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560404 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 04:39:58.560683 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.560410 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 04:39:58.560767 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.560689 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 04:39:58.560767 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.560689 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 04:39:58.562295 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.562284 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 04:39:58.562295 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.562295 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 04:39:58.563957 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.563942 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d586l" Jul 20 04:39:58.565938 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.565924 2553 server.go:1268] "Started kubelet" Jul 20 04:39:58.566152 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.566092 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 04:39:58.566246 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.566222 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 04:39:58.566511 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.566235 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 04:39:58.567034 ip-10-0-139-1 systemd[1]: Started Kubernetes Kubelet. Jul 20 04:39:58.567954 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.567911 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 04:39:58.568704 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.568690 2553 server.go:310] "Adding debug handlers to kubelet server" Jul 20 04:39:58.572005 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.571988 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 04:39:58.577335 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.577320 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 04:39:58.577404 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.577362 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 04:39:58.577555 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.577530 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:58.577668 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.577647 2553 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-1.ec2.internal" not found Jul 20 04:39:58.578142 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578125 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 04:39:58.578278 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578250 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 04:39:58.578380 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578171 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 04:39:58.578499 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578477 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 04:39:58.578499 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578490 2553 factory.go:55] Registering systemd factory Jul 20 04:39:58.578600 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578501 2553 factory.go:223] Registration of the systemd container factory successfully Jul 20 04:39:58.578860 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578847 2553 factory.go:153] Registering CRI-O factory Jul 20 04:39:58.578931 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578863 2553 factory.go:223] Registration of the crio container factory successfully Jul 20 04:39:58.578931 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578888 2553 factory.go:103] Registering Raw factory Jul 20 04:39:58.578931 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578902 2553 manager.go:1196] Started watching for new ooms in manager Jul 20 04:39:58.578931 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578908 2553 reconstruct.go:97] "Volume reconstruction finished" Jul 20 04:39:58.578931 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.578917 2553 reconciler.go:29] "Reconciler: start to sync state" Jul 20 04:39:58.579301 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.579288 2553 manager.go:349] Starting recovery of all containers Jul 20 04:39:58.580269 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.580205 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 04:39:58.583398 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.583282 2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-1.ec2.internal\" not found" node="ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.587109 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.586898 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 04:39:58.590839 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.590820 2553 manager.go:354] Recovery completed Jul 20 04:39:58.593933 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.593918 2553 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-1.ec2.internal" not found Jul 20 04:39:58.595194 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.595182 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 04:39:58.599499 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.599479 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory" Jul 20 04:39:58.599573 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.599514 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 04:39:58.599573 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.599528 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID" Jul 20 04:39:58.600093 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.600080 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 04:39:58.600093 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.600093 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 04:39:58.600219 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.600092 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 04:39:58.600219 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.600133 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 20 04:39:58.600830 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.600812 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory" Jul 20 04:39:58.600894 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.600844 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 04:39:58.600939 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.600923 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID" Jul 20 04:39:58.601448 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.601437 2553 policy_none.go:49] "None policy: Start" Jul 20 04:39:58.601497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.601454 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 04:39:58.601497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.601468 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 04:39:58.602445 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.602435 2553 policy_none.go:47] "Start" Jul 20 04:39:58.648942 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.648925 2553 manager.go:337] "Starting Device Plugin manager" Jul 20 04:39:58.665322 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.648957 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 04:39:58.665322 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.648967 2553 server.go:87] "Starting device plugin registration server" Jul 20 04:39:58.665322 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.649209 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 04:39:58.665322 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.649218 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 04:39:58.665322 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.649330 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 04:39:58.665322 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.649403 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 04:39:58.665322 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.649410 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 04:39:58.665322 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.650084 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 04:39:58.665322 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.650140 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:58.674322 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.674291 2553 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-1.ec2.internal" not found Jul 20 04:39:58.690811 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.690789 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 04:39:58.690944 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.690840 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 04:39:58.690944 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.690867 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 04:39:58.690944 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.690900 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 04:39:58.693755 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.693728 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 04:39:58.750027 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.749949 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 04:39:58.750998 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.750978 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory" Jul 20 04:39:58.751115 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.751010 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 04:39:58.751115 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.751022 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID" Jul 20 04:39:58.751115 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.751048 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.760509 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.760490 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.760630 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.760517 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-1.ec2.internal\": node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:58.776463 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.776433 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:58.791896 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.791863 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"] Jul 20 04:39:58.791980 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.791955 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 04:39:58.793438 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.793420 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory" Jul 20 04:39:58.793541 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.793453 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 04:39:58.793541 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.793466 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID" Jul 20 04:39:58.795721 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.795706 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 04:39:58.795857 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.795842 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.795899 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.795875 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 04:39:58.796453 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.796436 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory" Jul 20 04:39:58.796517 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.796465 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 04:39:58.796517 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.796475 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID" Jul 20 04:39:58.796517 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.796442 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory" Jul 20 04:39:58.796625 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.796543 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 04:39:58.796625 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.796560 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID" Jul 20 04:39:58.798709 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.798691 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.798789 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.798723 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 04:39:58.799426 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.799408 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientMemory" Jul 20 04:39:58.799524 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.799439 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 04:39:58.799524 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.799449 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeHasSufficientPID" Jul 20 04:39:58.826153 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.826124 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-1.ec2.internal\" not found" node="ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.829457 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.829440 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-1.ec2.internal\" not found" node="ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.876693 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.876663 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:58.880355 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.880328 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.880451 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.880365 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4359bec0e352431350db386bdadf6398-config\") pod \"kube-apiserver-proxy-ip-10-0-139-1.ec2.internal\" (UID: \"4359bec0e352431350db386bdadf6398\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.880451 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.880386 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.977742 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:58.977712 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:58.980971 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.980958 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.981020 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.980979 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.981020 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.980996 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4359bec0e352431350db386bdadf6398-config\") pod \"kube-apiserver-proxy-ip-10-0-139-1.ec2.internal\" (UID: \"4359bec0e352431350db386bdadf6398\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.981100 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.981022 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4359bec0e352431350db386bdadf6398-config\") pod \"kube-apiserver-proxy-ip-10-0-139-1.ec2.internal\" (UID: \"4359bec0e352431350db386bdadf6398\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.981100 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.981055 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" Jul 20 04:39:58.981100 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:58.981089 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a315493ff7ec57552d98ccbaa050d33e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal\" (UID: \"a315493ff7ec57552d98ccbaa050d33e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" Jul 20 04:39:59.078494 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.078416 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:59.129780 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.129750 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" Jul 20 04:39:59.132904 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.132888 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" Jul 20 04:39:59.179158 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.179127 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:59.279604 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.279571 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:59.380108 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.380071 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:59.480604 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.480574 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-1.ec2.internal\" not found" Jul 20 04:39:59.506858 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.506823 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 04:39:59.507029 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.507005 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 04:39:59.507067 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.507005 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 04:39:59.521807 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.521780 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 04:39:59.550599 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.550567 2553 apiserver.go:52] "Watching apiserver" Jul 20 04:39:59.560097 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.560069 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 04:39:59.562144 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.562114 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5t9gn","openshift-multus/multus-additional-cni-plugins-vsktp","openshift-network-diagnostics/network-check-target-b59px","kube-system/global-pull-secret-syncer-htwc8","kube-system/konnectivity-agent-4xdjb","openshift-cluster-node-tuning-operator/tuned-w4mpx","openshift-dns/node-resolver-rzb5h","openshift-multus/multus-jbjt5","openshift-multus/network-metrics-daemon-v84j5","openshift-network-operator/iptables-alerter-q8cvv","openshift-ovn-kubernetes/ovnkube-node-jb67f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v"] Jul 20 04:39:59.564855 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.564830 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.566940 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.566915 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.567104 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.567080 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mj6nd\"" Jul 20 04:39:59.567326 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.567286 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 04:39:59.567444 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.567425 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 04:39:59.567500 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.567482 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 04:39:59.568980 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.568931 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 04:34:58 +0000 UTC" deadline="2028-01-18 04:50:31.120121579 +0000 UTC" Jul 20 04:39:59.568980 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.568977 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13128h10m31.551147242s" Jul 20 04:39:59.569132 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.569068 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 04:39:59.569132 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.569093 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 04:39:59.569352 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.569330 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:39:59.569450 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.569435 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hzswg\"" Jul 20 04:39:59.569517 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.569436 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:39:59.569732 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.569706 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 04:39:59.569732 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.569724 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 04:39:59.569853 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.569755 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 04:39:59.572519 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.572504 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:39:59.572583 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.572560 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:39:59.574973 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.574958 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:39:59.576912 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.576896 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 04:39:59.577065 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.577047 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m4gv4\"" Jul 20 04:39:59.577130 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.577065 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 04:39:59.577701 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.577682 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 04:39:59.577805 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.577685 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" Jul 20 04:39:59.577805 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.577690 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.580218 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.580198 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wddmd\"" Jul 20 04:39:59.580336 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.580253 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 04:39:59.580336 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.580280 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 04:39:59.580456 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.580390 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.582331 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.582297 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 04:39:59.582427 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.582390 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wkw26\"" Jul 20 04:39:59.582484 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.582471 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 04:39:59.583544 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583529 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.583796 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583779 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-sysconfig\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.583842 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583807 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-run\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.583842 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583833 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eac9bab1-d00f-4b62-be3c-da339ba1c9b2-serviceca\") pod \"node-ca-5t9gn\" (UID: \"eac9bab1-d00f-4b62-be3c-da339ba1c9b2\") " pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.583929 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583850 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/827bf049-ea44-42b4-b2b3-ea4f2c141dda-hosts-file\") pod \"node-resolver-rzb5h\" (UID: \"827bf049-ea44-42b4-b2b3-ea4f2c141dda\") " pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.583929 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583866 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23183526-71fe-40ba-b073-a0cd6fc654f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.583929 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583891 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23183526-71fe-40ba-b073-a0cd6fc654f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.583929 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583914 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9efa6ae-6769-4312-af64-b15c8d641f83-dbus\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:39:59.584080 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583931 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-system-cni-dir\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.584080 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583944 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-lib-modules\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584080 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583958 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-var-lib-kubelet\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584080 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583978 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-sys\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584080 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.583994 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/401ea0f7-035a-4dcc-b506-14c3d5cf6a1d-agent-certs\") pod \"konnectivity-agent-4xdjb\" (UID: \"401ea0f7-035a-4dcc-b506-14c3d5cf6a1d\") " pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:39:59.584080 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584009 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/401ea0f7-035a-4dcc-b506-14c3d5cf6a1d-konnectivity-ca\") pod \"konnectivity-agent-4xdjb\" (UID: \"401ea0f7-035a-4dcc-b506-14c3d5cf6a1d\") " pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:39:59.584080 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584023 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqhdr\" (UniqueName: \"kubernetes.io/projected/eac9bab1-d00f-4b62-be3c-da339ba1c9b2-kube-api-access-lqhdr\") pod \"node-ca-5t9gn\" (UID: \"eac9bab1-d00f-4b62-be3c-da339ba1c9b2\") " pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.584080 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584061 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-os-release\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.584080 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584076 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23183526-71fe-40ba-b073-a0cd6fc654f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584090 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584104 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4ld4\" (UniqueName: \"kubernetes.io/projected/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-kube-api-access-v4ld4\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584120 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/827bf049-ea44-42b4-b2b3-ea4f2c141dda-tmp-dir\") pod \"node-resolver-rzb5h\" (UID: \"827bf049-ea44-42b4-b2b3-ea4f2c141dda\") " pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584136 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nfkk\" (UniqueName: \"kubernetes.io/projected/23183526-71fe-40ba-b073-a0cd6fc654f4-kube-api-access-8nfkk\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584150 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-modprobe-d\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584164 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-sysctl-conf\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584193 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-host\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584219 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eac9bab1-d00f-4b62-be3c-da339ba1c9b2-host\") pod \"node-ca-5t9gn\" (UID: \"eac9bab1-d00f-4b62-be3c-da339ba1c9b2\") " pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584245 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584263 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnv86\" (UniqueName: \"kubernetes.io/projected/827bf049-ea44-42b4-b2b3-ea4f2c141dda-kube-api-access-rnv86\") pod \"node-resolver-rzb5h\" (UID: \"827bf049-ea44-42b4-b2b3-ea4f2c141dda\") " pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584277 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584293 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-cnibin\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584334 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-sysctl-d\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584348 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-tmp\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584363 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9efa6ae-6769-4312-af64-b15c8d641f83-kubelet-config\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:39:59.584414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584377 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-kubernetes\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584889 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584401 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-systemd\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.584889 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.584420 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-tuned\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.585333 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.585300 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 04:39:59.585536 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.585523 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rk4vw\"" Jul 20 04:39:59.585803 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.585788 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:39:59.585873 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.585854 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:39:59.588158 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.588141 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 04:39:59.588247 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.588199 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" Jul 20 04:39:59.588595 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.588579 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.589039 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.589010 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 04:39:59.590884 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.590863 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 04:39:59.590985 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.590951 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zfwc6\"" Jul 20 04:39:59.591095 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.591079 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 04:39:59.591271 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.591257 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.591403 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.591386 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 04:39:59.593250 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.593232 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 04:39:59.593410 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.593289 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 04:39:59.593602 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.593583 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 04:39:59.593669 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.593648 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 04:39:59.593726 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.593701 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 04:39:59.593819 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.593801 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 04:39:59.593868 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.593831 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lgbdp\"" Jul 20 04:39:59.593905 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.593881 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal"] Jul 20 04:39:59.594029 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.594017 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.597265 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.596456 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v6cjc\"" Jul 20 04:39:59.597265 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.596496 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 04:39:59.597265 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.596457 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 04:39:59.597265 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.596903 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 04:39:59.599902 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.599881 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal"] Jul 20 04:39:59.599902 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.599896 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 04:39:59.615376 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.615360 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbqwt" Jul 20 04:39:59.623479 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.623462 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbqwt" Jul 20 04:39:59.679359 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.679341 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 04:39:59.684715 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684694 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eac9bab1-d00f-4b62-be3c-da339ba1c9b2-host\") pod \"node-ca-5t9gn\" (UID: \"eac9bab1-d00f-4b62-be3c-da339ba1c9b2\") " pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.684807 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684723 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-ovnkube-config\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.684807 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684744 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-cnibin\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.684807 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-os-release\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.684807 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684791 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eac9bab1-d00f-4b62-be3c-da339ba1c9b2-host\") pod \"node-ca-5t9gn\" (UID: \"eac9bab1-d00f-4b62-be3c-da339ba1c9b2\") " pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.684807 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684797 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0feb6b46-1f57-4cac-b855-962c4bc18915-cni-binary-copy\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.684990 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684821 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-etc-kubernetes\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.684990 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684824 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-cnibin\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.684990 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684837 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-kubernetes\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.684990 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684875 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-kubernetes\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.684990 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684881 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eac9bab1-d00f-4b62-be3c-da339ba1c9b2-serviceca\") pod \"node-ca-5t9gn\" (UID: \"eac9bab1-d00f-4b62-be3c-da339ba1c9b2\") " pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.684990 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684903 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23183526-71fe-40ba-b073-a0cd6fc654f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.684990 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.684922 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-slash\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.685232 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685016 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-etc-openvswitch\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.685232 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685041 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-system-cni-dir\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.685232 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685066 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-var-lib-kubelet\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.685232 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685092 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-cni-bin\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.685232 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685132 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-system-cni-dir\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.685232 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685166 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-lib-modules\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.685232 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685187 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-run-netns\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.685232 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685201 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-system-cni-dir\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.685232 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685204 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-ovnkube-script-lib\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685236 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-registration-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685258 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-etc-selinux\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685276 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-run-netns\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685297 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685343 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-sys\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685364 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-lib-modules\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685370 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eac9bab1-d00f-4b62-be3c-da339ba1c9b2-serviceca\") pod \"node-ca-5t9gn\" (UID: \"eac9bab1-d00f-4b62-be3c-da339ba1c9b2\") " pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685371 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqhdr\" (UniqueName: \"kubernetes.io/projected/eac9bab1-d00f-4b62-be3c-da339ba1c9b2-kube-api-access-lqhdr\") pod \"node-ca-5t9gn\" (UID: \"eac9bab1-d00f-4b62-be3c-da339ba1c9b2\") " pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685416 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685450 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-cni-dir\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685459 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23183526-71fe-40ba-b073-a0cd6fc654f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685472 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-run-k8s-cni-cncf-io\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685498 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfkk\" (UniqueName: \"kubernetes.io/projected/23183526-71fe-40ba-b073-a0cd6fc654f4-kube-api-access-8nfkk\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.685512 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685520 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/acf1ee21-6ad1-41aa-b601-1a6d043d571f-iptables-alerter-script\") pod \"iptables-alerter-q8cvv\" (UID: \"acf1ee21-6ad1-41aa-b601-1a6d043d571f\") " pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685528 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-sys\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.685598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685543 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-device-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.685588 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret podName:d9efa6ae-6769-4312-af64-b15c8d641f83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:00.185553628 +0000 UTC m=+2.016883718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret") pod "global-pull-secret-syncer-htwc8" (UID: "d9efa6ae-6769-4312-af64-b15c8d641f83") : object "kube-system"/"original-pull-secret" not registered Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685607 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-cnibin\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685635 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-socket-dir-parent\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685676 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-var-lib-cni-multus\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685713 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acf1ee21-6ad1-41aa-b601-1a6d043d571f-host-slash\") pod \"iptables-alerter-q8cvv\" (UID: \"acf1ee21-6ad1-41aa-b601-1a6d043d571f\") " pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685731 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-run-openvswitch\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-log-socket\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685809 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-sys-fs\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685836 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-modprobe-d\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685867 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-sysctl-conf\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685892 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-host\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685913 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685936 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnv86\" (UniqueName: \"kubernetes.io/projected/827bf049-ea44-42b4-b2b3-ea4f2c141dda-kube-api-access-rnv86\") pod \"node-resolver-rzb5h\" (UID: \"827bf049-ea44-42b4-b2b3-ea4f2c141dda\") " pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685962 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685976 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-modprobe-d\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.686319 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685983 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-run-ovn\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685999 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-host\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.685994 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-sysctl-conf\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686020 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-sysctl-d\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686042 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-tmp\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686064 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9efa6ae-6769-4312-af64-b15c8d641f83-kubelet-config\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686095 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-run-systemd\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686124 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686130 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686156 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk8k7\" (UniqueName: \"kubernetes.io/projected/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-kube-api-access-sk8k7\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686190 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9efa6ae-6769-4312-af64-b15c8d641f83-kubelet-config\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686198 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-systemd\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686217 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-sysctl-d\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686215 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-tuned\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686268 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-systemd\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686269 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686364 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-sysconfig\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686301 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-sysconfig\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686410 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-run\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686414 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686430 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/827bf049-ea44-42b4-b2b3-ea4f2c141dda-hosts-file\") pod \"node-resolver-rzb5h\" (UID: \"827bf049-ea44-42b4-b2b3-ea4f2c141dda\") " pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686445 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23183526-71fe-40ba-b073-a0cd6fc654f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686464 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9efa6ae-6769-4312-af64-b15c8d641f83-dbus\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686489 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-kubelet\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686512 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/827bf049-ea44-42b4-b2b3-ea4f2c141dda-hosts-file\") pod \"node-resolver-rzb5h\" (UID: \"827bf049-ea44-42b4-b2b3-ea4f2c141dda\") " pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686523 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-run\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686513 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-socket-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686556 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-run-multus-certs\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686583 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-cni-netd\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686609 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-var-lib-kubelet\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686634 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-systemd-units\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686656 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-node-log\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686678 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8gz\" (UniqueName: \"kubernetes.io/projected/0feb6b46-1f57-4cac-b855-962c4bc18915-kube-api-access-hk8gz\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686675 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9efa6ae-6769-4312-af64-b15c8d641f83-dbus\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:39:59.687881 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686721 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-var-lib-kubelet\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686749 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sksjq\" (UniqueName: \"kubernetes.io/projected/3673a269-04f3-4369-9467-fea04e2ddf96-kube-api-access-sksjq\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686780 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/401ea0f7-035a-4dcc-b506-14c3d5cf6a1d-agent-certs\") pod \"konnectivity-agent-4xdjb\" (UID: \"401ea0f7-035a-4dcc-b506-14c3d5cf6a1d\") " pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686806 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/401ea0f7-035a-4dcc-b506-14c3d5cf6a1d-konnectivity-ca\") pod \"konnectivity-agent-4xdjb\" (UID: \"401ea0f7-035a-4dcc-b506-14c3d5cf6a1d\") " pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686831 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-os-release\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686857 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23183526-71fe-40ba-b073-a0cd6fc654f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686869 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23183526-71fe-40ba-b073-a0cd6fc654f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686884 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-ovn-node-metrics-cert\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686926 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mnp2\" (UniqueName: \"kubernetes.io/projected/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-kube-api-access-7mnp2\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.686962 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687002 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4ld4\" (UniqueName: \"kubernetes.io/projected/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-kube-api-access-v4ld4\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/827bf049-ea44-42b4-b2b3-ea4f2c141dda-tmp-dir\") pod \"node-resolver-rzb5h\" (UID: \"827bf049-ea44-42b4-b2b3-ea4f2c141dda\") " pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687052 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-var-lib-cni-bin\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687067 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-hostroot\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687112 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-conf-dir\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687132 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/23183526-71fe-40ba-b073-a0cd6fc654f4-os-release\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687357 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/401ea0f7-035a-4dcc-b506-14c3d5cf6a1d-konnectivity-ca\") pod \"konnectivity-agent-4xdjb\" (UID: \"401ea0f7-035a-4dcc-b506-14c3d5cf6a1d\") " pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:39:59.688378 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687442 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/827bf049-ea44-42b4-b2b3-ea4f2c141dda-tmp-dir\") pod \"node-resolver-rzb5h\" (UID: \"827bf049-ea44-42b4-b2b3-ea4f2c141dda\") " pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.689223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687624 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23183526-71fe-40ba-b073-a0cd6fc654f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.689223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687647 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5vqh\" (UniqueName: \"kubernetes.io/projected/acf1ee21-6ad1-41aa-b601-1a6d043d571f-kube-api-access-m5vqh\") pod \"iptables-alerter-q8cvv\" (UID: \"acf1ee21-6ad1-41aa-b601-1a6d043d571f\") " pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.689223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687684 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-var-lib-openvswitch\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.689223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687718 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-env-overrides\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.689223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.687742 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-daemon-config\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.690211 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.690189 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-etc-tuned\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.690295 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.690219 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-tmp\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.690392 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.690378 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/401ea0f7-035a-4dcc-b506-14c3d5cf6a1d-agent-certs\") pod \"konnectivity-agent-4xdjb\" (UID: \"401ea0f7-035a-4dcc-b506-14c3d5cf6a1d\") " pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:39:59.693770 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.693751 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 04:39:59.693863 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.693788 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 04:39:59.693863 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.693802 2553 projected.go:196] Error preparing data for projected volume kube-api-access-mjc9g for pod openshift-network-diagnostics/network-check-target-b59px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:39:59.693863 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.693861 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g podName:d5bb0178-a4e8-479b-90a5-28827b1aca83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:00.193832584 +0000 UTC m=+2.025162680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mjc9g" (UniqueName: "kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g") pod "network-check-target-b59px" (UID: "d5bb0178-a4e8-479b-90a5-28827b1aca83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:39:59.696285 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.696267 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqhdr\" (UniqueName: \"kubernetes.io/projected/eac9bab1-d00f-4b62-be3c-da339ba1c9b2-kube-api-access-lqhdr\") pod \"node-ca-5t9gn\" (UID: \"eac9bab1-d00f-4b62-be3c-da339ba1c9b2\") " pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.696494 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.696473 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4ld4\" (UniqueName: \"kubernetes.io/projected/2448242f-1b4a-4a1c-a2dc-e0f200c5b50f-kube-api-access-v4ld4\") pod \"tuned-w4mpx\" (UID: \"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.696749 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.696724 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnv86\" (UniqueName: \"kubernetes.io/projected/827bf049-ea44-42b4-b2b3-ea4f2c141dda-kube-api-access-rnv86\") pod \"node-resolver-rzb5h\" (UID: \"827bf049-ea44-42b4-b2b3-ea4f2c141dda\") " pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.696824 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.696754 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nfkk\" (UniqueName: \"kubernetes.io/projected/23183526-71fe-40ba-b073-a0cd6fc654f4-kube-api-access-8nfkk\") pod \"multus-additional-cni-plugins-vsktp\" (UID: \"23183526-71fe-40ba-b073-a0cd6fc654f4\") " pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.707682 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.707662 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 04:39:59.755413 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:59.755384 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4359bec0e352431350db386bdadf6398.slice/crio-7914dfe6ea1c0db6f37e63ac715df57ec255d02fc05ba2727d4b54f5da34d263 WatchSource:0}: Error finding container 7914dfe6ea1c0db6f37e63ac715df57ec255d02fc05ba2727d4b54f5da34d263: Status 404 returned error can't find the container with id 7914dfe6ea1c0db6f37e63ac715df57ec255d02fc05ba2727d4b54f5da34d263 Jul 20 04:39:59.755583 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:59.755569 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda315493ff7ec57552d98ccbaa050d33e.slice/crio-8da3932011ecd3688354b2367d971e3076d10439fdad34bb9f74291b167d7677 WatchSource:0}: Error finding container 8da3932011ecd3688354b2367d971e3076d10439fdad34bb9f74291b167d7677: Status 404 returned error can't find the container with id 8da3932011ecd3688354b2367d971e3076d10439fdad34bb9f74291b167d7677 Jul 20 04:39:59.759887 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.759872 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 04:39:59.788285 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788256 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-ovnkube-script-lib\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.788285 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788284 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-registration-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.788461 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788302 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-etc-selinux\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.788461 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788343 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-run-netns\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788461 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788366 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.788461 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788400 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-registration-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.788461 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788421 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-run-netns\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788461 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788407 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-cni-dir\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788461 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788453 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788464 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-cni-dir\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788463 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-etc-selinux\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788511 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-run-k8s-cni-cncf-io\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788500 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-run-k8s-cni-cncf-io\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788551 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/acf1ee21-6ad1-41aa-b601-1a6d043d571f-iptables-alerter-script\") pod \"iptables-alerter-q8cvv\" (UID: \"acf1ee21-6ad1-41aa-b601-1a6d043d571f\") " pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788577 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-device-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788610 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-cnibin\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788650 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-socket-dir-parent\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788654 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-device-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788672 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-var-lib-cni-multus\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788703 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-cnibin\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788697 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acf1ee21-6ad1-41aa-b601-1a6d043d571f-host-slash\") pod \"iptables-alerter-q8cvv\" (UID: \"acf1ee21-6ad1-41aa-b601-1a6d043d571f\") " pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788753 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acf1ee21-6ad1-41aa-b601-1a6d043d571f-host-slash\") pod \"iptables-alerter-q8cvv\" (UID: \"acf1ee21-6ad1-41aa-b601-1a6d043d571f\") " pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788749 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-var-lib-cni-multus\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788751 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-socket-dir-parent\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788752 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-run-openvswitch\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.788799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788804 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-log-socket\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788809 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-run-openvswitch\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788826 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-sys-fs\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788855 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-log-socket\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788857 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-ovnkube-script-lib\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788873 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-sys-fs\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788875 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-run-ovn\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788908 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-run-ovn\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788911 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-run-systemd\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788941 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-run-systemd\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788939 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788974 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.788978 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk8k7\" (UniqueName: \"kubernetes.io/projected/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-kube-api-access-sk8k7\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789028 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789053 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-kubelet\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789072 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-socket-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789084 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/acf1ee21-6ad1-41aa-b601-1a6d043d571f-iptables-alerter-script\") pod \"iptables-alerter-q8cvv\" (UID: \"acf1ee21-6ad1-41aa-b601-1a6d043d571f\") " pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.789604 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789095 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-run-multus-certs\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789117 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-cni-netd\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789133 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-kubelet\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789142 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-systemd-units\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789163 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-run-multus-certs\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789165 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-node-log\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.789171 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789178 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-socket-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789194 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-node-log\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789195 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8gz\" (UniqueName: \"kubernetes.io/projected/0feb6b46-1f57-4cac-b855-962c4bc18915-kube-api-access-hk8gz\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789212 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-cni-netd\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:39:59.789224 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:00.289207036 +0000 UTC m=+2.120537142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789224 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-systemd-units\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789257 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sksjq\" (UniqueName: \"kubernetes.io/projected/3673a269-04f3-4369-9467-fea04e2ddf96-kube-api-access-sksjq\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789289 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-ovn-node-metrics-cert\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789332 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mnp2\" (UniqueName: \"kubernetes.io/projected/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-kube-api-access-7mnp2\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789357 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.790243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789390 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-var-lib-cni-bin\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789415 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-hostroot\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789440 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-conf-dir\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789463 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5vqh\" (UniqueName: \"kubernetes.io/projected/acf1ee21-6ad1-41aa-b601-1a6d043d571f-kube-api-access-m5vqh\") pod \"iptables-alerter-q8cvv\" (UID: \"acf1ee21-6ad1-41aa-b601-1a6d043d571f\") " pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789478 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-hostroot\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789491 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-var-lib-openvswitch\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789504 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-conf-dir\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789460 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789463 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-var-lib-cni-bin\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789516 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-env-overrides\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789532 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-var-lib-openvswitch\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789572 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-daemon-config\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789643 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-ovnkube-config\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789671 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-os-release\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789692 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0feb6b46-1f57-4cac-b855-962c4bc18915-cni-binary-copy\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789712 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-etc-kubernetes\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789736 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-slash\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789758 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-etc-openvswitch\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.790794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789762 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-os-release\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789781 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-system-cni-dir\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789814 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-etc-openvswitch\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789820 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-slash\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-var-lib-kubelet\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789858 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-cni-bin\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789866 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-etc-kubernetes\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789878 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-run-netns\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789895 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-system-cni-dir\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789904 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-cni-bin\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789856 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0feb6b46-1f57-4cac-b855-962c4bc18915-host-var-lib-kubelet\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789896 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-env-overrides\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.789939 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-host-run-netns\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.790151 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0feb6b46-1f57-4cac-b855-962c4bc18915-multus-daemon-config\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.790165 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0feb6b46-1f57-4cac-b855-962c4bc18915-cni-binary-copy\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.791273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.790386 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-ovnkube-config\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.791849 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.791833 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-ovn-node-metrics-cert\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.799205 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.799174 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5vqh\" (UniqueName: \"kubernetes.io/projected/acf1ee21-6ad1-41aa-b601-1a6d043d571f-kube-api-access-m5vqh\") pod \"iptables-alerter-q8cvv\" (UID: \"acf1ee21-6ad1-41aa-b601-1a6d043d571f\") " pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.799501 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.799468 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mnp2\" (UniqueName: \"kubernetes.io/projected/8cdad8ad-2d4d-45ec-ba97-93620eb23ff3-kube-api-access-7mnp2\") pod \"ovnkube-node-jb67f\" (UID: \"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:39:59.799592 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.799529 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8gz\" (UniqueName: \"kubernetes.io/projected/0feb6b46-1f57-4cac-b855-962c4bc18915-kube-api-access-hk8gz\") pod \"multus-jbjt5\" (UID: \"0feb6b46-1f57-4cac-b855-962c4bc18915\") " pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.799883 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.799866 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sksjq\" (UniqueName: \"kubernetes.io/projected/3673a269-04f3-4369-9467-fea04e2ddf96-kube-api-access-sksjq\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:39:59.800119 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.800100 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk8k7\" (UniqueName: \"kubernetes.io/projected/db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0-kube-api-access-sk8k7\") pod \"aws-ebs-csi-driver-node-22k2v\" (UID: \"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:39:59.896349 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.896319 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5t9gn" Jul 20 04:39:59.901654 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.901636 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vsktp" Jul 20 04:39:59.906650 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:59.906621 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac9bab1_d00f_4b62_be3c_da339ba1c9b2.slice/crio-f9448bafd90b2a75b797b86ed4edc7989a08cfa66e6f9e5f175ea6a32ee5fd57 WatchSource:0}: Error finding container f9448bafd90b2a75b797b86ed4edc7989a08cfa66e6f9e5f175ea6a32ee5fd57: Status 404 returned error can't find the container with id f9448bafd90b2a75b797b86ed4edc7989a08cfa66e6f9e5f175ea6a32ee5fd57 Jul 20 04:39:59.910422 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:59.910400 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23183526_71fe_40ba_b073_a0cd6fc654f4.slice/crio-eb39cee9c3a4d04b4a7647ca0d9742df9378babd88334691339ffa65f43224d8 WatchSource:0}: Error finding container eb39cee9c3a4d04b4a7647ca0d9742df9378babd88334691339ffa65f43224d8: Status 404 returned error can't find the container with id eb39cee9c3a4d04b4a7647ca0d9742df9378babd88334691339ffa65f43224d8 Jul 20 04:39:59.928135 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.928117 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:39:59.937548 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:59.937526 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401ea0f7_035a_4dcc_b506_14c3d5cf6a1d.slice/crio-bbc17ddc1f05c636d4a78e3893c89142b03b80d94b71f527878c3ed9d0f5e7f4 WatchSource:0}: Error finding container bbc17ddc1f05c636d4a78e3893c89142b03b80d94b71f527878c3ed9d0f5e7f4: Status 404 returned error can't find the container with id bbc17ddc1f05c636d4a78e3893c89142b03b80d94b71f527878c3ed9d0f5e7f4 Jul 20 04:39:59.944726 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.944705 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" Jul 20 04:39:59.953657 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:59.953619 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2448242f_1b4a_4a1c_a2dc_e0f200c5b50f.slice/crio-936e5d4edcb5aed6c770387b06b783657d643518182e9f66f24a800b6eb52805 WatchSource:0}: Error finding container 936e5d4edcb5aed6c770387b06b783657d643518182e9f66f24a800b6eb52805: Status 404 returned error can't find the container with id 936e5d4edcb5aed6c770387b06b783657d643518182e9f66f24a800b6eb52805 Jul 20 04:39:59.964395 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.964377 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzb5h" Jul 20 04:39:59.972336 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.972299 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbjt5" Jul 20 04:39:59.980834 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:59.980812 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0feb6b46_1f57_4cac_b855_962c4bc18915.slice/crio-8aa7285c5c5ad00d41fbb6c83fb03de681b2c2b1d4d378b86c388464e5d7b0fb WatchSource:0}: Error finding container 8aa7285c5c5ad00d41fbb6c83fb03de681b2c2b1d4d378b86c388464e5d7b0fb: Status 404 returned error can't find the container with id 8aa7285c5c5ad00d41fbb6c83fb03de681b2c2b1d4d378b86c388464e5d7b0fb Jul 20 04:39:59.990180 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:39:59.990161 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q8cvv" Jul 20 04:39:59.998378 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:39:59.998353 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf1ee21_6ad1_41aa_b601_1a6d043d571f.slice/crio-effc08257a6f27264ab9083f40aebadfcba4de41989e8a546e1f7f08a2b57aef WatchSource:0}: Error finding container effc08257a6f27264ab9083f40aebadfcba4de41989e8a546e1f7f08a2b57aef: Status 404 returned error can't find the container with id effc08257a6f27264ab9083f40aebadfcba4de41989e8a546e1f7f08a2b57aef Jul 20 04:40:00.019369 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.019349 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:40:00.024007 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.023985 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" Jul 20 04:40:00.030180 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:40:00.030148 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdad8ad_2d4d_45ec_ba97_93620eb23ff3.slice/crio-25ec2968ef79b54162a2c74c096b2a67cdd5408f06a9bd1cd7690f1466018fde WatchSource:0}: Error finding container 25ec2968ef79b54162a2c74c096b2a67cdd5408f06a9bd1cd7690f1466018fde: Status 404 returned error can't find the container with id 25ec2968ef79b54162a2c74c096b2a67cdd5408f06a9bd1cd7690f1466018fde Jul 20 04:40:00.034037 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:40:00.034010 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7fc0ee_1ae7_4138_a7ae_1da6e00b1fa0.slice/crio-993adf556dc13197e392f9375fdbac1b49bca2a8d62c0009312a8c134e260623 WatchSource:0}: Error finding container 993adf556dc13197e392f9375fdbac1b49bca2a8d62c0009312a8c134e260623: Status 404 returned error can't find the container with id 993adf556dc13197e392f9375fdbac1b49bca2a8d62c0009312a8c134e260623 Jul 20 04:40:00.192871 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.192792 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:00.193001 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:00.192960 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:00.193039 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:00.193014 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret podName:d9efa6ae-6769-4312-af64-b15c8d641f83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:01.192995804 +0000 UTC m=+3.024325887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret") pod "global-pull-secret-syncer-htwc8" (UID: "d9efa6ae-6769-4312-af64-b15c8d641f83") : object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:00.293272 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.293242 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:00.293492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.293299 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:00.293492 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:00.293447 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:00.293578 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:00.293509 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:01.29349262 +0000 UTC m=+3.124822723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:00.294016 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:00.293993 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 04:40:00.294108 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:00.294022 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 04:40:00.294108 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:00.294035 2553 projected.go:196] Error preparing data for projected volume kube-api-access-mjc9g for pod openshift-network-diagnostics/network-check-target-b59px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:00.294108 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:00.294090 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g podName:d5bb0178-a4e8-479b-90a5-28827b1aca83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:01.294072359 +0000 UTC m=+3.125402460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjc9g" (UniqueName: "kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g") pod "network-check-target-b59px" (UID: "d5bb0178-a4e8-479b-90a5-28827b1aca83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:00.509662 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.509573 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 04:40:00.627352 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.627296 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 04:34:59 +0000 UTC" deadline="2028-04-16 17:39:07.17698636 +0000 UTC" Jul 20 04:40:00.627352 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.627352 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15276h59m6.549639545s" Jul 20 04:40:00.693155 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.692617 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:00.693155 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:00.692768 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:00.721314 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.721248 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsktp" event={"ID":"23183526-71fe-40ba-b073-a0cd6fc654f4","Type":"ContainerStarted","Data":"eb39cee9c3a4d04b4a7647ca0d9742df9378babd88334691339ffa65f43224d8"} Jul 20 04:40:00.735949 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.735905 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5t9gn" event={"ID":"eac9bab1-d00f-4b62-be3c-da339ba1c9b2","Type":"ContainerStarted","Data":"f9448bafd90b2a75b797b86ed4edc7989a08cfa66e6f9e5f175ea6a32ee5fd57"} Jul 20 04:40:00.758056 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.758013 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"a315493ff7ec57552d98ccbaa050d33e","Type":"ContainerStarted","Data":"8da3932011ecd3688354b2367d971e3076d10439fdad34bb9f74291b167d7677"} Jul 20 04:40:00.774303 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.774214 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerStarted","Data":"25ec2968ef79b54162a2c74c096b2a67cdd5408f06a9bd1cd7690f1466018fde"} Jul 20 04:40:00.796532 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.796426 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbjt5" event={"ID":"0feb6b46-1f57-4cac-b855-962c4bc18915","Type":"ContainerStarted","Data":"8aa7285c5c5ad00d41fbb6c83fb03de681b2c2b1d4d378b86c388464e5d7b0fb"} Jul 20 04:40:00.816061 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.815994 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" event={"ID":"4359bec0e352431350db386bdadf6398","Type":"ContainerStarted","Data":"7914dfe6ea1c0db6f37e63ac715df57ec255d02fc05ba2727d4b54f5da34d263"} Jul 20 04:40:00.852577 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.852519 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" event={"ID":"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0","Type":"ContainerStarted","Data":"993adf556dc13197e392f9375fdbac1b49bca2a8d62c0009312a8c134e260623"} Jul 20 04:40:00.860495 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.860452 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q8cvv" event={"ID":"acf1ee21-6ad1-41aa-b601-1a6d043d571f","Type":"ContainerStarted","Data":"effc08257a6f27264ab9083f40aebadfcba4de41989e8a546e1f7f08a2b57aef"} Jul 20 04:40:00.867210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.867174 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzb5h" event={"ID":"827bf049-ea44-42b4-b2b3-ea4f2c141dda","Type":"ContainerStarted","Data":"6f9d3b61039741cb727b7e1d8ba0acde4a3733695cd6c91448a7c26c3c02130a"} Jul 20 04:40:00.888539 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.888494 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" event={"ID":"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f","Type":"ContainerStarted","Data":"936e5d4edcb5aed6c770387b06b783657d643518182e9f66f24a800b6eb52805"} Jul 20 04:40:00.898090 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:00.898039 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4xdjb" event={"ID":"401ea0f7-035a-4dcc-b506-14c3d5cf6a1d","Type":"ContainerStarted","Data":"bbc17ddc1f05c636d4a78e3893c89142b03b80d94b71f527878c3ed9d0f5e7f4"} Jul 20 04:40:01.080703 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:01.080611 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 04:40:01.205213 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:01.205168 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:01.205429 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.205407 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:01.205530 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.205490 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret podName:d9efa6ae-6769-4312-af64-b15c8d641f83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:03.205469406 +0000 UTC m=+5.036799507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret") pod "global-pull-secret-syncer-htwc8" (UID: "d9efa6ae-6769-4312-af64-b15c8d641f83") : object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:01.306141 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:01.306101 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:01.306385 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:01.306181 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:01.306385 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.306335 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 04:40:01.306385 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.306366 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 04:40:01.306385 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.306383 2553 projected.go:196] Error preparing data for projected volume kube-api-access-mjc9g for pod openshift-network-diagnostics/network-check-target-b59px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:01.306630 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.306333 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:01.306630 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.306449 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g podName:d5bb0178-a4e8-479b-90a5-28827b1aca83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:03.306428298 +0000 UTC m=+5.137758396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjc9g" (UniqueName: "kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g") pod "network-check-target-b59px" (UID: "d5bb0178-a4e8-479b-90a5-28827b1aca83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:01.306630 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.306492 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:03.306474965 +0000 UTC m=+5.137805050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:01.628474 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:01.628403 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 04:34:59 +0000 UTC" deadline="2028-03-18 06:42:05.259700332 +0000 UTC" Jul 20 04:40:01.628474 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:01.628471 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14570h2m3.631233742s" Jul 20 04:40:01.691671 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:01.691633 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:01.691839 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.691744 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:01.692219 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:01.692062 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:01.692219 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:01.692178 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:02.692519 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:02.692213 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:02.693052 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:02.692641 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:03.225674 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:03.225515 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:03.225917 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.225742 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:03.225917 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.225819 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret podName:d9efa6ae-6769-4312-af64-b15c8d641f83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:07.225798911 +0000 UTC m=+9.057129011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret") pod "global-pull-secret-syncer-htwc8" (UID: "d9efa6ae-6769-4312-af64-b15c8d641f83") : object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:03.326661 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:03.326599 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:03.326661 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:03.326661 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:03.326912 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.326838 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:03.326912 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.326908 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:07.326885811 +0000 UTC m=+9.158215902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:03.327414 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.327362 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 04:40:03.327414 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.327409 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 04:40:03.327586 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.327423 2553 projected.go:196] Error preparing data for projected volume kube-api-access-mjc9g for pod openshift-network-diagnostics/network-check-target-b59px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:03.327586 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.327474 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g podName:d5bb0178-a4e8-479b-90a5-28827b1aca83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:07.327456965 +0000 UTC m=+9.158787073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjc9g" (UniqueName: "kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g") pod "network-check-target-b59px" (UID: "d5bb0178-a4e8-479b-90a5-28827b1aca83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:03.692318 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:03.691657 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:03.692318 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.691802 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:03.692318 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:03.692170 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:03.692318 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:03.692274 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:04.695863 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:04.695830 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:04.696306 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:04.695958 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:05.691429 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:05.691390 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:05.691664 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:05.691550 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:05.692225 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:05.691974 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:05.692225 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:05.692074 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:06.695831 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:06.695795 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:06.696318 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:06.695909 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:07.263365 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:07.263208 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:07.263543 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.263378 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:07.263543 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.263443 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret podName:d9efa6ae-6769-4312-af64-b15c8d641f83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:15.263425553 +0000 UTC m=+17.094755657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret") pod "global-pull-secret-syncer-htwc8" (UID: "d9efa6ae-6769-4312-af64-b15c8d641f83") : object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:07.363913 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:07.363872 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:07.364094 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:07.363921 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:07.364094 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.364036 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:07.364094 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.364087 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:15.3640709 +0000 UTC m=+17.195400983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:07.364267 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.364163 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 04:40:07.364267 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.364178 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 04:40:07.364267 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.364191 2553 projected.go:196] Error preparing data for projected volume kube-api-access-mjc9g for pod openshift-network-diagnostics/network-check-target-b59px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:07.364267 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.364228 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g podName:d5bb0178-a4e8-479b-90a5-28827b1aca83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:15.364216179 +0000 UTC m=+17.195546275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjc9g" (UniqueName: "kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g") pod "network-check-target-b59px" (UID: "d5bb0178-a4e8-479b-90a5-28827b1aca83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:07.691089 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:07.691045 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:07.691289 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.691198 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:07.691624 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:07.691595 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:07.691732 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:07.691709 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:08.693528 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:08.693488 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:08.694066 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:08.693603 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:09.691797 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:09.691255 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:09.691797 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:09.691299 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:09.691797 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:09.691428 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:09.691797 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:09.691555 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:10.691628 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:10.691589 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:10.692069 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:10.691757 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:11.691586 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:11.691547 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:11.691756 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:11.691671 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:11.692122 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:11.692040 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:11.692179 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:11.692129 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:12.691133 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:12.691098 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:12.691336 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:12.691235 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:13.691780 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:13.691742 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:13.692187 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:13.691758 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:13.692187 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:13.691855 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:13.692187 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:13.691974 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:14.692481 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:14.692442 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:14.692871 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:14.692561 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:15.325005 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:15.324963 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:15.325292 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.325170 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:15.325292 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.325246 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret podName:d9efa6ae-6769-4312-af64-b15c8d641f83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:31.325224472 +0000 UTC m=+33.156554571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret") pod "global-pull-secret-syncer-htwc8" (UID: "d9efa6ae-6769-4312-af64-b15c8d641f83") : object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:15.425865 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:15.425813 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:15.426041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:15.425874 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:15.426041 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.426001 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:15.426041 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.426015 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 04:40:15.426213 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.426048 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 04:40:15.426213 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.426061 2553 projected.go:196] Error preparing data for projected volume kube-api-access-mjc9g for pod openshift-network-diagnostics/network-check-target-b59px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:15.426213 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.426072 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:31.426051339 +0000 UTC m=+33.257381425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:15.426213 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.426124 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g podName:d5bb0178-a4e8-479b-90a5-28827b1aca83 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:31.426108698 +0000 UTC m=+33.257438783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjc9g" (UniqueName: "kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g") pod "network-check-target-b59px" (UID: "d5bb0178-a4e8-479b-90a5-28827b1aca83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:15.691587 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:15.691242 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:15.691587 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.691422 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:15.691587 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:15.691468 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:15.691587 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:15.691556 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:16.691901 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:16.691865 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:16.692363 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:16.692007 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:17.691879 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:17.691838 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:17.692089 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:17.691843 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:17.692089 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:17.691989 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:17.692528 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:17.692110 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:18.692170 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:18.692141 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:18.692582 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:18.692243 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:19.691412 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:19.691361 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:19.691605 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:19.691511 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:19.692179 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:19.691922 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:19.692179 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:19.692020 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:20.691206 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:20.691071 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:20.691335 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:20.691202 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:20.968478 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:20.968226 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" event={"ID":"2448242f-1b4a-4a1c-a2dc-e0f200c5b50f","Type":"ContainerStarted","Data":"af5be3d4c403fbc33968258bb623c8465150b80a227faf960e9325fd422ef4eb"} Jul 20 04:40:20.971472 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:20.971447 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:40:20.971996 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:20.971971 2553 generic.go:356] "Generic (PLEG): container finished" podID="8cdad8ad-2d4d-45ec-ba97-93620eb23ff3" containerID="29c44a01599586b4e17a069fc52726a3266160c9c731dfef3df9e7d2d958bfa7" exitCode=1 Jul 20 04:40:20.972086 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:20.972044 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerDied","Data":"29c44a01599586b4e17a069fc52726a3266160c9c731dfef3df9e7d2d958bfa7"} Jul 20 04:40:20.972134 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:20.972111 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerStarted","Data":"f1963aef55e16a5983e91bf95a2f5b727978f986f5fa0b56a5488b80febf32e4"} Jul 20 04:40:20.974363 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:20.974007 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbjt5" event={"ID":"0feb6b46-1f57-4cac-b855-962c4bc18915","Type":"ContainerStarted","Data":"d0c6d99cce7aea15131ad528a66cb96872e22ced594da03df16751ae55cc8824"} Jul 20 04:40:20.976248 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:20.975961 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" event={"ID":"4359bec0e352431350db386bdadf6398","Type":"ContainerStarted","Data":"266dc864680c29ded08b3cd5e9d97dba929d37c7d383f52a20484e0454cd6665"} Jul 20 04:40:20.984334 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:20.984159 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w4mpx" podStartSLOduration=1.349358831 podStartE2EDuration="21.984146215s" totalImagesPullingTime="20.634787384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:20.983960905 +0000 UTC m=+22.815291009" watchObservedRunningTime="2026-07-20 04:40:20.984146215 +0000 UTC m=+22.815476320" Jul 20 04:40:21.000867 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.000825 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jbjt5" podStartSLOduration=1.160781232 podStartE2EDuration="22.000810239s" totalImagesPullingTime="20.840029007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:21.000553961 +0000 UTC m=+22.831884085" watchObservedRunningTime="2026-07-20 04:40:21.000810239 +0000 UTC m=+22.832140354" Jul 20 04:40:21.016575 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.016532 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-1.ec2.internal" podStartSLOduration=22.016516586 podStartE2EDuration="22.016516586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:21.016001096 +0000 UTC m=+22.847331202" watchObservedRunningTime="2026-07-20 04:40:21.016516586 +0000 UTC m=+22.847846690" Jul 20 04:40:21.691687 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.691496 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:21.691852 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.691535 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:21.691852 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:21.691774 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:21.691926 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:21.691847 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:21.980578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.980539 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" event={"ID":"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0","Type":"ContainerStarted","Data":"95ecd55b181b041a90b76d3630039e6204cbb7faa7839d1b27ac830f53116f06"} Jul 20 04:40:21.982199 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.982143 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q8cvv" event={"ID":"acf1ee21-6ad1-41aa-b601-1a6d043d571f","Type":"ContainerStarted","Data":"8ce2020ee296ba3455cc6206e5b3eac3a5eb1c91dada6a08936409c91004b4bb"} Jul 20 04:40:21.984120 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.984093 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzb5h" event={"ID":"827bf049-ea44-42b4-b2b3-ea4f2c141dda","Type":"ContainerStarted","Data":"66d64e8cda573b5ac08cf95cef20786b1153a2d9e902bcf45341af19ca21d704"} Jul 20 04:40:21.989167 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.989103 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4xdjb" event={"ID":"401ea0f7-035a-4dcc-b506-14c3d5cf6a1d","Type":"ContainerStarted","Data":"bb936bc7e8485f6118a75dea7e40a7c377c15ef1ad3eb58841d1377c2c5c5ef0"} Jul 20 04:40:21.990864 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.990833 2553 generic.go:356] "Generic (PLEG): container finished" podID="23183526-71fe-40ba-b073-a0cd6fc654f4" containerID="245a6f4f0b3d802184bbd03e90652950a48f65328a47aede3ea9915c84ad58cc" exitCode=0 Jul 20 04:40:21.990973 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.990916 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsktp" event={"ID":"23183526-71fe-40ba-b073-a0cd6fc654f4","Type":"ContainerDied","Data":"245a6f4f0b3d802184bbd03e90652950a48f65328a47aede3ea9915c84ad58cc"} Jul 20 04:40:21.992560 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.992506 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5t9gn" event={"ID":"eac9bab1-d00f-4b62-be3c-da339ba1c9b2","Type":"ContainerStarted","Data":"b60f5b47aa68a2201518c77efa2c6289edb7275a96e8542ced70e032a373cc03"} Jul 20 04:40:21.994092 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.994069 2553 generic.go:356] "Generic (PLEG): container finished" podID="a315493ff7ec57552d98ccbaa050d33e" containerID="27f6b5e2246625cacc8530bef1ae874ea91f5519d0a98f758768586f32e6624d" exitCode=0 Jul 20 04:40:21.994182 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.994151 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"a315493ff7ec57552d98ccbaa050d33e","Type":"ContainerDied","Data":"27f6b5e2246625cacc8530bef1ae874ea91f5519d0a98f758768586f32e6624d"} Jul 20 04:40:21.997242 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.997197 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q8cvv" podStartSLOduration=2.559203107 podStartE2EDuration="22.997179698s" totalImagesPullingTime="20.437976591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:21.996510338 +0000 UTC m=+23.827840443" watchObservedRunningTime="2026-07-20 04:40:21.997179698 +0000 UTC m=+23.828509805" Jul 20 04:40:21.997242 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.997241 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:40:21.998073 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.998048 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerStarted","Data":"3a64a28196b981b362bd0e57b35aea33645f941573a2b714902924e935c9edf4"} Jul 20 04:40:21.998160 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.998129 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerStarted","Data":"ec366dc9f017c49d32f41451fdfc1b01f552e4ff99b76186fbe19a66750b6f8c"} Jul 20 04:40:21.998222 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.998198 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerStarted","Data":"6abd586e3a09e252ec6111ef7bde2a2a1ac8746858a8d062805e306fc2d613a6"} Jul 20 04:40:21.998283 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:21.998262 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerStarted","Data":"234c8fea6ecc3837e8bb1dc5066f05ed09021cf9097a1ca07f461dfa38516c95"} Jul 20 04:40:22.045889 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:22.044923 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4xdjb" podStartSLOduration=10.862177652 podStartE2EDuration="23.044901736s" totalImagesPullingTime="12.182724084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:22.026242041 +0000 UTC m=+23.857572150" watchObservedRunningTime="2026-07-20 04:40:22.044901736 +0000 UTC m=+23.876231842" Jul 20 04:40:22.075000 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:22.074952 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rzb5h" podStartSLOduration=2.594979662 podStartE2EDuration="23.074937402s" totalImagesPullingTime="20.47995774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:22.074834045 +0000 UTC m=+23.906164150" watchObservedRunningTime="2026-07-20 04:40:22.074937402 +0000 UTC m=+23.906267507" Jul 20 04:40:22.075463 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:22.075430 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5t9gn" podStartSLOduration=2.529352394 podStartE2EDuration="23.075419468s" totalImagesPullingTime="20.546067074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:22.057739978 +0000 UTC m=+23.889070083" watchObservedRunningTime="2026-07-20 04:40:22.075419468 +0000 UTC m=+23.906749574" Jul 20 04:40:22.691714 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:22.691684 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:22.691954 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:22.691806 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:22.835494 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:22.835443 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 04:40:23.002869 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:23.002782 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" event={"ID":"a315493ff7ec57552d98ccbaa050d33e","Type":"ContainerStarted","Data":"f4a450929adcff4b7192e58d05372460bdd5505359cbadc566e314eff72aa0d7"} Jul 20 04:40:23.004917 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:23.004829 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" event={"ID":"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0","Type":"ContainerStarted","Data":"8bb0d0bb0a5ba55e711812cad28b35361827128b38983b250e8d5bd3d570204f"} Jul 20 04:40:23.016070 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:23.016013 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-1.ec2.internal" podStartSLOduration=24.015999549 podStartE2EDuration="24.015999549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:23.015364996 +0000 UTC m=+24.846695103" watchObservedRunningTime="2026-07-20 04:40:23.015999549 +0000 UTC m=+24.847329654" Jul 20 04:40:23.665507 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:23.665367 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T04:40:22.83545938Z","UUID":"fb7766f3-3d42-4010-bc92-e58a534c8027","Handler":null,"Name":"","Endpoint":""} Jul 20 04:40:23.666976 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:23.666955 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 04:40:23.667107 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:23.666992 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 04:40:23.691084 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:23.691060 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:23.691260 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:23.691164 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:23.691512 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:23.691481 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:23.691644 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:23.691610 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:24.010779 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:24.010756 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:40:24.011257 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:24.011220 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerStarted","Data":"b1a4fc645345c4fdc68a2bf97f8efdcfd5946772edc7be9a986a0cabb8776ae3"} Jul 20 04:40:24.691699 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:24.691501 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:24.691887 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:24.691796 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:25.016114 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:25.016039 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" event={"ID":"db7fc0ee-1ae7-4138-a7ae-1da6e00b1fa0","Type":"ContainerStarted","Data":"824069d56e445fa22a35dff33b700a0f41fc6d91f041ff52f49d8345704986c0"} Jul 20 04:40:25.032105 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:25.032061 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-22k2v" podStartSLOduration=3.050275415 podStartE2EDuration="26.032047226s" totalImagesPullingTime="22.981771811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:25.031770155 +0000 UTC m=+26.863100284" watchObservedRunningTime="2026-07-20 04:40:25.032047226 +0000 UTC m=+26.863377332" Jul 20 04:40:25.691720 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:25.691684 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:25.691885 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:25.691822 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:25.691940 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:25.691882 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:25.692037 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:25.692009 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:26.691557 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:26.691385 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:26.692117 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:26.691645 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:26.760238 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:26.760199 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:40:26.760802 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:26.760786 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:40:27.023962 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.023930 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:40:27.024396 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.024365 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerStarted","Data":"19cf6087f76d4d27b595423f38c50d116f3b192cd4ee9ff2903eda63a9469f67"} Jul 20 04:40:27.024625 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.024605 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:40:27.024712 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.024676 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:40:27.024806 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.024793 2553 scope.go:117] "RemoveContainer" containerID="29c44a01599586b4e17a069fc52726a3266160c9c731dfef3df9e7d2d958bfa7" Jul 20 04:40:27.026244 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.026218 2553 generic.go:356] "Generic (PLEG): container finished" podID="23183526-71fe-40ba-b073-a0cd6fc654f4" containerID="14b77a100dbe58a7c56b82b939a2a6995837a580570857277b6198ca8f687351" exitCode=0 Jul 20 04:40:27.026369 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.026290 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsktp" event={"ID":"23183526-71fe-40ba-b073-a0cd6fc654f4","Type":"ContainerDied","Data":"14b77a100dbe58a7c56b82b939a2a6995837a580570857277b6198ca8f687351"} Jul 20 04:40:27.041675 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.041655 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:40:27.691501 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.691469 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:27.691501 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:27.691494 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:27.692036 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:27.691590 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:27.692036 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:27.691724 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:28.032714 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.032693 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:40:28.033119 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.033074 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" event={"ID":"8cdad8ad-2d4d-45ec-ba97-93620eb23ff3","Type":"ContainerStarted","Data":"e7ad721edb09e972d9e1f281e19a30b30402694c6f5b8b5a61850926310d2b3c"} Jul 20 04:40:28.033495 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.033402 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:40:28.052736 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.052701 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:40:28.064454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.064404 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" podStartSLOduration=8.457937684000001 podStartE2EDuration="29.06438639s" totalImagesPullingTime="20.606448706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:28.062361452 +0000 UTC m=+29.893691548" watchObservedRunningTime="2026-07-20 04:40:28.06438639 +0000 UTC m=+29.895716494" Jul 20 04:40:28.263653 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.263557 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b59px"] Jul 20 04:40:28.263808 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.263745 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:28.263901 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:28.263877 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:28.264292 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.264275 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v84j5"] Jul 20 04:40:28.264391 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.264380 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:28.264479 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:28.264460 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:28.265954 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.265928 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-htwc8"] Jul 20 04:40:28.266086 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:28.266031 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:28.266143 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:28.266118 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:29.037444 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:29.037408 2553 generic.go:356] "Generic (PLEG): container finished" podID="23183526-71fe-40ba-b073-a0cd6fc654f4" containerID="68270edf028ddc26358af249f8287964c1cea8d5f6fb4c91801bd6f9e148e4e9" exitCode=0 Jul 20 04:40:29.037819 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:29.037498 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsktp" event={"ID":"23183526-71fe-40ba-b073-a0cd6fc654f4","Type":"ContainerDied","Data":"68270edf028ddc26358af249f8287964c1cea8d5f6fb4c91801bd6f9e148e4e9"} Jul 20 04:40:29.692334 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:29.692147 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:29.692498 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:29.692147 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:29.692498 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:29.692475 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:29.692590 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:29.692531 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:29.827470 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:29.827428 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:40:29.827646 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:29.827581 2553 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 20 04:40:29.828585 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:29.828566 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4xdjb" Jul 20 04:40:30.692083 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:30.692047 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:30.692553 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:30.692170 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:31.044025 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:31.043944 2553 generic.go:356] "Generic (PLEG): container finished" podID="23183526-71fe-40ba-b073-a0cd6fc654f4" containerID="9b8fe7ce9e84ea0376171fb820a14b56c3abeda6f37218d5bfd1f3b0e56545dc" exitCode=0 Jul 20 04:40:31.044025 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:31.043981 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsktp" event={"ID":"23183526-71fe-40ba-b073-a0cd6fc654f4","Type":"ContainerDied","Data":"9b8fe7ce9e84ea0376171fb820a14b56c3abeda6f37218d5bfd1f3b0e56545dc"} Jul 20 04:40:31.343474 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:31.343445 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:31.343631 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.343588 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:31.343677 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.343657 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret podName:d9efa6ae-6769-4312-af64-b15c8d641f83 nodeName:}" failed. No retries permitted until 2026-07-20 04:41:03.343639987 +0000 UTC m=+65.174970074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret") pod "global-pull-secret-syncer-htwc8" (UID: "d9efa6ae-6769-4312-af64-b15c8d641f83") : object "kube-system"/"original-pull-secret" not registered Jul 20 04:40:31.443849 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:31.443813 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:31.443849 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:31.443854 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:31.444057 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.443961 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:31.444057 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.443971 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 04:40:31.444057 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.443993 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 04:40:31.444057 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.444006 2553 projected.go:196] Error preparing data for projected volume kube-api-access-mjc9g for pod openshift-network-diagnostics/network-check-target-b59px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:31.444057 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.444028 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:41:03.444009963 +0000 UTC m=+65.275340049 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 04:40:31.444057 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.444044 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g podName:d5bb0178-a4e8-479b-90a5-28827b1aca83 nodeName:}" failed. No retries permitted until 2026-07-20 04:41:03.444035286 +0000 UTC m=+65.275365389 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjc9g" (UniqueName: "kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g") pod "network-check-target-b59px" (UID: "d5bb0178-a4e8-479b-90a5-28827b1aca83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 04:40:31.692145 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:31.692066 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:31.692145 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:31.692113 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:31.692562 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.692199 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b59px" podUID="d5bb0178-a4e8-479b-90a5-28827b1aca83" Jul 20 04:40:31.692562 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:31.692302 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htwc8" podUID="d9efa6ae-6769-4312-af64-b15c8d641f83" Jul 20 04:40:32.691631 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:32.691597 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:32.691806 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:32.691742 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:40:33.521223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.521146 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-1.ec2.internal" event="NodeReady" Jul 20 04:40:33.521753 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.521350 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 04:40:33.561631 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.561601 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z7z4r"] Jul 20 04:40:33.564961 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.564923 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84bb8"] Jul 20 04:40:33.565116 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.565062 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.567033 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.566745 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84bb8" Jul 20 04:40:33.567644 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.567618 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 04:40:33.567769 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.567712 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wnw2z\"" Jul 20 04:40:33.568088 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.568038 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 04:40:33.568949 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.568868 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 04:40:33.569104 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.568953 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 04:40:33.569104 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.569007 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cbmbt\"" Jul 20 04:40:33.569231 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.569141 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 04:40:33.573764 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.573613 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7z4r"] Jul 20 04:40:33.576461 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.576439 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84bb8"] Jul 20 04:40:33.658238 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.658202 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.658436 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.658273 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-config-volume\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.658436 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.658341 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgwbd\" (UniqueName: \"kubernetes.io/projected/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-kube-api-access-xgwbd\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.658436 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.658371 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs8xw\" (UniqueName: \"kubernetes.io/projected/5265bc55-f1c7-4009-bd94-8e52da59a793-kube-api-access-vs8xw\") pod \"ingress-canary-84bb8\" (UID: \"5265bc55-f1c7-4009-bd94-8e52da59a793\") " pod="openshift-ingress-canary/ingress-canary-84bb8" Jul 20 04:40:33.658436 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.658424 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5265bc55-f1c7-4009-bd94-8e52da59a793-cert\") pod \"ingress-canary-84bb8\" (UID: \"5265bc55-f1c7-4009-bd94-8e52da59a793\") " pod="openshift-ingress-canary/ingress-canary-84bb8" Jul 20 04:40:33.658608 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.658473 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-tmp-dir\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.691461 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.691419 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:40:33.691649 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.691468 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:40:33.694162 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.694126 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9vw5k\"" Jul 20 04:40:33.694162 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.694146 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 04:40:33.694362 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.694128 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 04:40:33.694362 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.694127 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 04:40:33.759231 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.759194 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgwbd\" (UniqueName: \"kubernetes.io/projected/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-kube-api-access-xgwbd\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.759427 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.759243 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs8xw\" (UniqueName: \"kubernetes.io/projected/5265bc55-f1c7-4009-bd94-8e52da59a793-kube-api-access-vs8xw\") pod \"ingress-canary-84bb8\" (UID: \"5265bc55-f1c7-4009-bd94-8e52da59a793\") " pod="openshift-ingress-canary/ingress-canary-84bb8" Jul 20 04:40:33.759427 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.759295 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5265bc55-f1c7-4009-bd94-8e52da59a793-cert\") pod \"ingress-canary-84bb8\" (UID: \"5265bc55-f1c7-4009-bd94-8e52da59a793\") " pod="openshift-ingress-canary/ingress-canary-84bb8" Jul 20 04:40:33.759427 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.759362 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-tmp-dir\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.759427 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.759402 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.759606 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.759465 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-config-volume\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.759849 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:33.759803 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 04:40:33.759993 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:33.759904 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls podName:a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:34.259882528 +0000 UTC m=+36.091212627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls") pod "dns-default-z7z4r" (UID: "a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8") : secret "dns-default-metrics-tls" not found Jul 20 04:40:33.759993 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.759983 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-tmp-dir\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.760098 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.760008 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-config-volume\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.764434 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.764414 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5265bc55-f1c7-4009-bd94-8e52da59a793-cert\") pod \"ingress-canary-84bb8\" (UID: \"5265bc55-f1c7-4009-bd94-8e52da59a793\") " pod="openshift-ingress-canary/ingress-canary-84bb8" Jul 20 04:40:33.767853 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.767825 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgwbd\" (UniqueName: \"kubernetes.io/projected/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-kube-api-access-xgwbd\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:33.768689 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.768662 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs8xw\" (UniqueName: \"kubernetes.io/projected/5265bc55-f1c7-4009-bd94-8e52da59a793-kube-api-access-vs8xw\") pod \"ingress-canary-84bb8\" (UID: \"5265bc55-f1c7-4009-bd94-8e52da59a793\") " pod="openshift-ingress-canary/ingress-canary-84bb8" Jul 20 04:40:33.886361 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:33.886296 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84bb8" Jul 20 04:40:34.262113 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:34.262023 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:34.262285 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:34.262185 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 04:40:34.262285 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:34.262256 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls podName:a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:35.262237062 +0000 UTC m=+37.093567165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls") pod "dns-default-z7z4r" (UID: "a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8") : secret "dns-default-metrics-tls" not found Jul 20 04:40:34.691774 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:34.691733 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:40:34.694096 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:34.694067 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 04:40:34.694218 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:34.694204 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-892m2\"" Jul 20 04:40:35.247519 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:35.247235 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84bb8"] Jul 20 04:40:35.250857 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:40:35.250830 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5265bc55_f1c7_4009_bd94_8e52da59a793.slice/crio-15444f25d2ece41b0c8f343dd91d58e3a2f2213c380f3ea77023576fb24b3755 WatchSource:0}: Error finding container 15444f25d2ece41b0c8f343dd91d58e3a2f2213c380f3ea77023576fb24b3755: Status 404 returned error can't find the container with id 15444f25d2ece41b0c8f343dd91d58e3a2f2213c380f3ea77023576fb24b3755 Jul 20 04:40:35.270534 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:35.270503 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:35.270677 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:35.270657 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 04:40:35.270733 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:35.270724 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls podName:a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:37.270707602 +0000 UTC m=+39.102037684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls") pod "dns-default-z7z4r" (UID: "a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8") : secret "dns-default-metrics-tls" not found Jul 20 04:40:36.061030 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:36.060996 2553 generic.go:356] "Generic (PLEG): container finished" podID="23183526-71fe-40ba-b073-a0cd6fc654f4" containerID="ad35855b5e3dbda8d1cbf6396ccc7135d8281a29911382ea3bb087d04e4ca69c" exitCode=0 Jul 20 04:40:36.061480 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:36.061078 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsktp" event={"ID":"23183526-71fe-40ba-b073-a0cd6fc654f4","Type":"ContainerDied","Data":"ad35855b5e3dbda8d1cbf6396ccc7135d8281a29911382ea3bb087d04e4ca69c"} Jul 20 04:40:36.062416 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:36.062393 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84bb8" event={"ID":"5265bc55-f1c7-4009-bd94-8e52da59a793","Type":"ContainerStarted","Data":"15444f25d2ece41b0c8f343dd91d58e3a2f2213c380f3ea77023576fb24b3755"} Jul 20 04:40:37.069342 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:37.069283 2553 generic.go:356] "Generic (PLEG): container finished" podID="23183526-71fe-40ba-b073-a0cd6fc654f4" containerID="7828fd065b58a14a12e50fe7d197aea1bbba44cbcf7618ab5a7d404e06c09ad9" exitCode=0 Jul 20 04:40:37.069833 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:37.069385 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsktp" event={"ID":"23183526-71fe-40ba-b073-a0cd6fc654f4","Type":"ContainerDied","Data":"7828fd065b58a14a12e50fe7d197aea1bbba44cbcf7618ab5a7d404e06c09ad9"} Jul 20 04:40:37.284063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:37.284033 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:37.284191 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:37.284179 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 04:40:37.284253 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:37.284243 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls podName:a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:41.284225106 +0000 UTC m=+43.115555210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls") pod "dns-default-z7z4r" (UID: "a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8") : secret "dns-default-metrics-tls" not found Jul 20 04:40:38.075762 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:38.075502 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vsktp" event={"ID":"23183526-71fe-40ba-b073-a0cd6fc654f4","Type":"ContainerStarted","Data":"64a71ddb5486d88f6036b2d410bb145c47cbbb6289204e0bbf539c96880c4149"} Jul 20 04:40:38.077207 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:38.077178 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84bb8" event={"ID":"5265bc55-f1c7-4009-bd94-8e52da59a793","Type":"ContainerStarted","Data":"c6b7be4fec504b670b7a663a1189a25f1567d8ad27b226fd2d9a68e7794a88d0"} Jul 20 04:40:38.097058 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:38.096994 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vsktp" podStartSLOduration=7.849790829 podStartE2EDuration="39.096973949s" totalImagesPullingTime="31.24718312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:38.096552309 +0000 UTC m=+39.927882414" watchObservedRunningTime="2026-07-20 04:40:38.096973949 +0000 UTC m=+39.928304045" Jul 20 04:40:38.110697 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:38.110651 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84bb8" podStartSLOduration=2.74929316 podStartE2EDuration="5.11063583s" totalImagesPullingTime="2.36134267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:40:38.109954809 +0000 UTC m=+39.941284916" watchObservedRunningTime="2026-07-20 04:40:38.11063583 +0000 UTC m=+39.941965934" Jul 20 04:40:41.310819 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:41.310782 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:41.311204 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:41.310949 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 04:40:41.311204 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:41.311013 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls podName:a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8 nodeName:}" failed. No retries permitted until 2026-07-20 04:40:49.310994779 +0000 UTC m=+51.142324878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls") pod "dns-default-z7z4r" (UID: "a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8") : secret "dns-default-metrics-tls" not found Jul 20 04:40:49.368616 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:40:49.368571 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:40:49.369087 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:49.368744 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 04:40:49.369087 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:40:49.368826 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls podName:a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8 nodeName:}" failed. No retries permitted until 2026-07-20 04:41:05.368808814 +0000 UTC m=+67.200138900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls") pod "dns-default-z7z4r" (UID: "a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8") : secret "dns-default-metrics-tls" not found Jul 20 04:41:00.059750 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:00.059721 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jb67f" Jul 20 04:41:03.362722 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.362664 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:41:03.365184 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.365162 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 04:41:03.377024 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.376992 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9efa6ae-6769-4312-af64-b15c8d641f83-original-pull-secret\") pod \"global-pull-secret-syncer-htwc8\" (UID: \"d9efa6ae-6769-4312-af64-b15c8d641f83\") " pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:41:03.410270 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.410236 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htwc8" Jul 20 04:41:03.463847 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.463815 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:41:03.463966 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.463864 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:41:03.466398 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.466375 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 04:41:03.466516 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.466447 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 04:41:03.474452 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:41:03.474331 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 04:41:03.474452 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:41:03.474414 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:42:07.474381622 +0000 UTC m=+129.305711706 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : secret "metrics-daemon-secret" not found Jul 20 04:41:03.476526 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.476331 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 04:41:03.487648 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.487602 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjc9g\" (UniqueName: \"kubernetes.io/projected/d5bb0178-a4e8-479b-90a5-28827b1aca83-kube-api-access-mjc9g\") pod \"network-check-target-b59px\" (UID: \"d5bb0178-a4e8-479b-90a5-28827b1aca83\") " pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:41:03.533660 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.533627 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-htwc8"] Jul 20 04:41:03.538255 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:41:03.538230 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9efa6ae_6769_4312_af64_b15c8d641f83.slice/crio-7652d1f62d672c16885255eefc14e9c28cf797274dbd2cf3bcf896866b8506ae WatchSource:0}: Error finding container 7652d1f62d672c16885255eefc14e9c28cf797274dbd2cf3bcf896866b8506ae: Status 404 returned error can't find the container with id 7652d1f62d672c16885255eefc14e9c28cf797274dbd2cf3bcf896866b8506ae Jul 20 04:41:03.705926 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.705848 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9vw5k\"" Jul 20 04:41:03.714709 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.714691 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:41:03.834922 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:03.834893 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b59px"] Jul 20 04:41:03.838085 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:41:03.838050 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bb0178_a4e8_479b_90a5_28827b1aca83.slice/crio-d65a2656b30c2cdfff7b1b86baa7f67b2326ff35340d9fdc91d30f61d93e4132 WatchSource:0}: Error finding container d65a2656b30c2cdfff7b1b86baa7f67b2326ff35340d9fdc91d30f61d93e4132: Status 404 returned error can't find the container with id d65a2656b30c2cdfff7b1b86baa7f67b2326ff35340d9fdc91d30f61d93e4132 Jul 20 04:41:04.137728 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:04.137691 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b59px" event={"ID":"d5bb0178-a4e8-479b-90a5-28827b1aca83","Type":"ContainerStarted","Data":"d65a2656b30c2cdfff7b1b86baa7f67b2326ff35340d9fdc91d30f61d93e4132"} Jul 20 04:41:04.138997 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:04.138962 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-htwc8" event={"ID":"d9efa6ae-6769-4312-af64-b15c8d641f83","Type":"ContainerStarted","Data":"7652d1f62d672c16885255eefc14e9c28cf797274dbd2cf3bcf896866b8506ae"} Jul 20 04:41:05.379926 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:05.379404 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:41:05.379926 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:41:05.379537 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 04:41:05.379926 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:41:05.379612 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls podName:a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8 nodeName:}" failed. No retries permitted until 2026-07-20 04:41:37.379592385 +0000 UTC m=+99.210922472 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls") pod "dns-default-z7z4r" (UID: "a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8") : secret "dns-default-metrics-tls" not found Jul 20 04:41:09.153069 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:09.153023 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b59px" event={"ID":"d5bb0178-a4e8-479b-90a5-28827b1aca83","Type":"ContainerStarted","Data":"f86a6a877aa61dd4715cd1509865d236923ca5ab1032a6d76454737755abb68f"} Jul 20 04:41:09.153599 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:09.153113 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:41:09.154504 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:09.154481 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-htwc8" event={"ID":"d9efa6ae-6769-4312-af64-b15c8d641f83","Type":"ContainerStarted","Data":"17ec8a1cd4ee697c05a0fb0116b8340a6ef9f60c254032039d605409f0cfc254"} Jul 20 04:41:09.180027 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:09.179977 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b59px" podStartSLOduration=65.477718357 podStartE2EDuration="1m10.179958999s" totalImagesPullingTime="4.702240642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:41:09.166807827 +0000 UTC m=+70.998137957" watchObservedRunningTime="2026-07-20 04:41:09.179958999 +0000 UTC m=+71.011289104" Jul 20 04:41:09.180165 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:09.180061 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-htwc8" podStartSLOduration=65.166413199 podStartE2EDuration="1m10.18005524s" totalImagesPullingTime="5.013642041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:41:09.179540222 +0000 UTC m=+71.010870327" watchObservedRunningTime="2026-07-20 04:41:09.18005524 +0000 UTC m=+71.011385345" Jul 20 04:41:23.515221 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.515103 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc"] Jul 20 04:41:23.519126 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.519109 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.521662 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.521635 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 20 04:41:23.521767 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.521745 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 20 04:41:23.521877 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.521861 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 20 04:41:23.522836 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.522817 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 20 04:41:23.527030 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.526032 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc"] Jul 20 04:41:23.603850 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.603806 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ccf83086-32ed-434a-ae60-6297fadb2ddd-klusterlet-config\") pod \"klusterlet-addon-workmgr-57dc67955f-mpzsc\" (UID: \"ccf83086-32ed-434a-ae60-6297fadb2ddd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.603850 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.603851 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6772\" (UniqueName: \"kubernetes.io/projected/ccf83086-32ed-434a-ae60-6297fadb2ddd-kube-api-access-k6772\") pod \"klusterlet-addon-workmgr-57dc67955f-mpzsc\" (UID: \"ccf83086-32ed-434a-ae60-6297fadb2ddd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.604053 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.603911 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf83086-32ed-434a-ae60-6297fadb2ddd-tmp\") pod \"klusterlet-addon-workmgr-57dc67955f-mpzsc\" (UID: \"ccf83086-32ed-434a-ae60-6297fadb2ddd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.704202 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.704170 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ccf83086-32ed-434a-ae60-6297fadb2ddd-klusterlet-config\") pod \"klusterlet-addon-workmgr-57dc67955f-mpzsc\" (UID: \"ccf83086-32ed-434a-ae60-6297fadb2ddd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.704348 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.704208 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6772\" (UniqueName: \"kubernetes.io/projected/ccf83086-32ed-434a-ae60-6297fadb2ddd-kube-api-access-k6772\") pod \"klusterlet-addon-workmgr-57dc67955f-mpzsc\" (UID: \"ccf83086-32ed-434a-ae60-6297fadb2ddd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.704348 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.704250 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf83086-32ed-434a-ae60-6297fadb2ddd-tmp\") pod \"klusterlet-addon-workmgr-57dc67955f-mpzsc\" (UID: \"ccf83086-32ed-434a-ae60-6297fadb2ddd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.704702 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.704685 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf83086-32ed-434a-ae60-6297fadb2ddd-tmp\") pod \"klusterlet-addon-workmgr-57dc67955f-mpzsc\" (UID: \"ccf83086-32ed-434a-ae60-6297fadb2ddd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.706937 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.706917 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ccf83086-32ed-434a-ae60-6297fadb2ddd-klusterlet-config\") pod \"klusterlet-addon-workmgr-57dc67955f-mpzsc\" (UID: \"ccf83086-32ed-434a-ae60-6297fadb2ddd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.712148 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.712124 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6772\" (UniqueName: \"kubernetes.io/projected/ccf83086-32ed-434a-ae60-6297fadb2ddd-kube-api-access-k6772\") pod \"klusterlet-addon-workmgr-57dc67955f-mpzsc\" (UID: \"ccf83086-32ed-434a-ae60-6297fadb2ddd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.829940 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.829847 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:23.955725 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:23.955697 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc"] Jul 20 04:41:23.958739 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:41:23.958716 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf83086_32ed_434a_ae60_6297fadb2ddd.slice/crio-ed815eeec7237f2d0e9a1857863fb6c60cbe73f9ca0101ee945763abc62b83ed WatchSource:0}: Error finding container ed815eeec7237f2d0e9a1857863fb6c60cbe73f9ca0101ee945763abc62b83ed: Status 404 returned error can't find the container with id ed815eeec7237f2d0e9a1857863fb6c60cbe73f9ca0101ee945763abc62b83ed Jul 20 04:41:24.194494 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:24.194455 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" event={"ID":"ccf83086-32ed-434a-ae60-6297fadb2ddd","Type":"ContainerStarted","Data":"ed815eeec7237f2d0e9a1857863fb6c60cbe73f9ca0101ee945763abc62b83ed"} Jul 20 04:41:28.205711 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:28.205674 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" event={"ID":"ccf83086-32ed-434a-ae60-6297fadb2ddd","Type":"ContainerStarted","Data":"d6fbc7e053b8b0449e0b015942cf593bdd60e48daa5b2579d2e0f6773264a1b5"} Jul 20 04:41:28.206134 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:28.205879 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:28.207643 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:28.207624 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:41:28.219415 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:28.219365 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" podStartSLOduration=1.5694686770000001 podStartE2EDuration="5.219350664s" totalImagesPullingTime="3.649881987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:41:28.218939336 +0000 UTC m=+90.050269442" watchObservedRunningTime="2026-07-20 04:41:28.219350664 +0000 UTC m=+90.050680769" Jul 20 04:41:37.394337 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:37.394260 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:41:37.394786 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:41:37.394423 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 04:41:37.394786 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:41:37.394508 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls podName:a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8 nodeName:}" failed. No retries permitted until 2026-07-20 04:42:41.394490277 +0000 UTC m=+163.225820360 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls") pod "dns-default-z7z4r" (UID: "a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8") : secret "dns-default-metrics-tls" not found Jul 20 04:41:40.160363 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:41:40.160337 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b59px" Jul 20 04:42:07.499652 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:42:07.497246 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:42:07.499652 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:42:07.497495 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 04:42:07.499652 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:42:07.497642 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:09.49761978 +0000 UTC m=+251.328949886 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : secret "metrics-daemon-secret" not found Jul 20 04:42:36.583395 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:42:36.580898 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z7z4r" podUID="a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8" Jul 20 04:42:37.378968 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:42:37.378939 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7z4r" Jul 20 04:42:37.702629 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:42:37.702546 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:42:41.441516 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:42:41.441460 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:42:41.441915 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:42:41.441616 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 04:42:41.441915 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:42:41.441688 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls podName:a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:43.441671232 +0000 UTC m=+285.273001314 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls") pod "dns-default-z7z4r" (UID: "a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8") : secret "dns-default-metrics-tls" not found Jul 20 04:42:52.691993 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:42:52.691915 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:43:28.206709 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:43:28.206660 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" podUID="ccf83086-32ed-434a-ae60-6297fadb2ddd" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jul 20 04:43:28.502796 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:43:28.502715 2553 generic.go:356] "Generic (PLEG): container finished" podID="ccf83086-32ed-434a-ae60-6297fadb2ddd" containerID="d6fbc7e053b8b0449e0b015942cf593bdd60e48daa5b2579d2e0f6773264a1b5" exitCode=1 Jul 20 04:43:28.502796 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:43:28.502754 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" event={"ID":"ccf83086-32ed-434a-ae60-6297fadb2ddd","Type":"ContainerDied","Data":"d6fbc7e053b8b0449e0b015942cf593bdd60e48daa5b2579d2e0f6773264a1b5"} Jul 20 04:43:28.503068 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:43:28.503056 2553 scope.go:117] "RemoveContainer" containerID="d6fbc7e053b8b0449e0b015942cf593bdd60e48daa5b2579d2e0f6773264a1b5" Jul 20 04:43:29.507904 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:43:29.507871 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" event={"ID":"ccf83086-32ed-434a-ae60-6297fadb2ddd","Type":"ContainerStarted","Data":"4ac0a0fa7d7bd9ef3c5459ba88bc540348ae98abc044a0a1050b7d1cd25f6354"} Jul 20 04:43:29.508302 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:43:29.508165 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:43:29.508744 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:43:29.508729 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57dc67955f-mpzsc" Jul 20 04:44:09.546295 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:09.546256 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:44:09.546786 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:09.546422 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 04:44:09.546786 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:09.546497 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs podName:3673a269-04f3-4369-9467-fea04e2ddf96 nodeName:}" failed. No retries permitted until 2026-07-20 04:46:11.546480878 +0000 UTC m=+373.377810961 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs") pod "network-metrics-daemon-v84j5" (UID: "3673a269-04f3-4369-9467-fea04e2ddf96") : secret "metrics-daemon-secret" not found Jul 20 04:44:22.047961 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.047886 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2"] Jul 20 04:44:22.050592 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.050575 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76dbc7645c-t6bts"] Jul 20 04:44:22.050711 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.050695 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2" Jul 20 04:44:22.053384 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.053366 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.054144 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.054126 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 20 04:44:22.054424 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.054407 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8c6ff\"" Jul 20 04:44:22.055002 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.054982 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 20 04:44:22.056156 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.056130 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 04:44:22.056498 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.056480 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 04:44:22.056714 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.056701 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-62h2j\"" Jul 20 04:44:22.056933 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.056919 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 04:44:22.064820 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.064798 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2"] Jul 20 04:44:22.066326 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.066287 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 04:44:22.072688 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.072667 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76dbc7645c-t6bts"] Jul 20 04:44:22.136661 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.136629 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-trusted-ca\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.136818 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.136669 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-image-registry-private-configuration\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.136818 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.136697 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-certificates\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.136818 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.136715 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-installation-pull-secrets\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.136818 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.136742 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-bound-sa-token\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.136818 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.136793 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f96f4b0-6794-48f1-95f3-432895ebce03-ca-trust-extracted\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.136818 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.136817 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrsj8\" (UniqueName: \"kubernetes.io/projected/dbba446d-f98d-4e41-8e02-7c03f5391120-kube-api-access-rrsj8\") pod \"volume-data-source-validator-78cf4c6f6-p5lq2\" (UID: \"dbba446d-f98d-4e41-8e02-7c03f5391120\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2" Jul 20 04:44:22.137063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.136846 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.137063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.136866 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clgz7\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-kube-api-access-clgz7\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.145595 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.145565 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bfgpv"] Jul 20 04:44:22.148425 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.148406 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jcd8d"] Jul 20 04:44:22.148578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.148542 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.150905 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.150884 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 04:44:22.151143 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.151127 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.151752 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.151731 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-h95jz\"" Jul 20 04:44:22.151752 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.151743 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 04:44:22.151960 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.151944 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 04:44:22.152007 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.151998 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 04:44:22.153042 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.153027 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 04:44:22.153249 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.153234 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 04:44:22.153506 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.153488 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 04:44:22.153783 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.153755 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 04:44:22.153873 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.153799 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mjhtj\"" Jul 20 04:44:22.157221 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.157204 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 04:44:22.158405 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.158389 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 04:44:22.163543 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.163511 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bfgpv"] Jul 20 04:44:22.164334 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.164298 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jcd8d"] Jul 20 04:44:22.237592 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.237557 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.237776 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.237596 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-trusted-ca\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.237776 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.237626 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-installation-pull-secrets\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.237776 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.237693 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrsj8\" (UniqueName: \"kubernetes.io/projected/dbba446d-f98d-4e41-8e02-7c03f5391120-kube-api-access-rrsj8\") pod \"volume-data-source-validator-78cf4c6f6-p5lq2\" (UID: \"dbba446d-f98d-4e41-8e02-7c03f5391120\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2" Jul 20 04:44:22.237776 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.237727 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-service-ca-bundle\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.237776 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.237756 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15097630-68a6-4704-9c96-2c619c3a76da-trusted-ca\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.238010 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.237780 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.238010 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.237850 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15097630-68a6-4704-9c96-2c619c3a76da-serving-cert\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.238010 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:22.237876 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 04:44:22.238010 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:22.237898 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dbc7645c-t6bts: secret "image-registry-tls" not found Jul 20 04:44:22.238010 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.237879 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d7xv\" (UniqueName: \"kubernetes.io/projected/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-kube-api-access-7d7xv\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.238010 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:22.237994 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls podName:8f96f4b0-6794-48f1-95f3-432895ebce03 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:22.737972685 +0000 UTC m=+264.569302781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls") pod "image-registry-76dbc7645c-t6bts" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03") : secret "image-registry-tls" not found Jul 20 04:44:22.238276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238038 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clgz7\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-kube-api-access-clgz7\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.238276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-image-registry-private-configuration\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.238276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238108 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-certificates\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.238276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238136 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-bound-sa-token\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.238276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238167 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-snapshots\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.238276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238192 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-serving-cert\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.238276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238244 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f96f4b0-6794-48f1-95f3-432895ebce03-ca-trust-extracted\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.238736 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238285 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15097630-68a6-4704-9c96-2c619c3a76da-config\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.238736 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238340 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqjr\" (UniqueName: \"kubernetes.io/projected/15097630-68a6-4704-9c96-2c619c3a76da-kube-api-access-vfqjr\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.238736 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238361 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-tmp\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.238736 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238636 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f96f4b0-6794-48f1-95f3-432895ebce03-ca-trust-extracted\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.238736 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238685 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-trusted-ca\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.238936 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.238817 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-certificates\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.240894 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.240870 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-image-registry-private-configuration\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.240983 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.240906 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-installation-pull-secrets\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.246964 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.246940 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clgz7\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-kube-api-access-clgz7\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.247158 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.247136 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrsj8\" (UniqueName: \"kubernetes.io/projected/dbba446d-f98d-4e41-8e02-7c03f5391120-kube-api-access-rrsj8\") pod \"volume-data-source-validator-78cf4c6f6-p5lq2\" (UID: \"dbba446d-f98d-4e41-8e02-7c03f5391120\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2" Jul 20 04:44:22.247339 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.247293 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-bound-sa-token\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.339053 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339026 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-snapshots\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.339185 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339059 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-serving-cert\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.339185 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339095 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15097630-68a6-4704-9c96-2c619c3a76da-config\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.339185 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339114 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqjr\" (UniqueName: \"kubernetes.io/projected/15097630-68a6-4704-9c96-2c619c3a76da-kube-api-access-vfqjr\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.339185 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339133 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-tmp\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.339185 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339151 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.339185 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339183 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-service-ca-bundle\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.339477 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339213 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15097630-68a6-4704-9c96-2c619c3a76da-trusted-ca\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.339477 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339256 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15097630-68a6-4704-9c96-2c619c3a76da-serving-cert\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.339477 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339288 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d7xv\" (UniqueName: \"kubernetes.io/projected/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-kube-api-access-7d7xv\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.339968 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339906 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-tmp\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.339968 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339929 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15097630-68a6-4704-9c96-2c619c3a76da-config\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.340147 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.339939 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-snapshots\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.340147 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.340013 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-service-ca-bundle\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.340329 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.340289 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15097630-68a6-4704-9c96-2c619c3a76da-trusted-ca\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.340452 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.340430 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.341732 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.341702 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-serving-cert\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.342041 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.342021 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15097630-68a6-4704-9c96-2c619c3a76da-serving-cert\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.346407 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.346386 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqjr\" (UniqueName: \"kubernetes.io/projected/15097630-68a6-4704-9c96-2c619c3a76da-kube-api-access-vfqjr\") pod \"console-operator-565b7b569d-bfgpv\" (UID: \"15097630-68a6-4704-9c96-2c619c3a76da\") " pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.346514 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.346439 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d7xv\" (UniqueName: \"kubernetes.io/projected/f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc-kube-api-access-7d7xv\") pod \"insights-operator-555d9d7885-jcd8d\" (UID: \"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc\") " pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.364174 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.364153 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2" Jul 20 04:44:22.459648 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.459621 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:22.464612 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.464596 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jcd8d" Jul 20 04:44:22.486736 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.486705 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2"] Jul 20 04:44:22.490428 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:44:22.490382 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbba446d_f98d_4e41_8e02_7c03f5391120.slice/crio-bd74b18394b8b30bf9924e61a930e9996781763ec530f5037593665adb21d987 WatchSource:0}: Error finding container bd74b18394b8b30bf9924e61a930e9996781763ec530f5037593665adb21d987: Status 404 returned error can't find the container with id bd74b18394b8b30bf9924e61a930e9996781763ec530f5037593665adb21d987 Jul 20 04:44:22.595247 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.595161 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bfgpv"] Jul 20 04:44:22.597998 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:44:22.597968 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15097630_68a6_4704_9c96_2c619c3a76da.slice/crio-96d0363146cdad0f60a83ff8d7a62edee8a92c3fcc643572eefb2c0af0fededf WatchSource:0}: Error finding container 96d0363146cdad0f60a83ff8d7a62edee8a92c3fcc643572eefb2c0af0fededf: Status 404 returned error can't find the container with id 96d0363146cdad0f60a83ff8d7a62edee8a92c3fcc643572eefb2c0af0fededf Jul 20 04:44:22.614552 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.614526 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jcd8d"] Jul 20 04:44:22.617793 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:44:22.617762 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b49fd8_bd3c_48c0_a15a_119a55a4b5dc.slice/crio-0cb440587eb0c1320c77cc1176d548f998136c03651329a92f7e6c4ba083521d WatchSource:0}: Error finding container 0cb440587eb0c1320c77cc1176d548f998136c03651329a92f7e6c4ba083521d: Status 404 returned error can't find the container with id 0cb440587eb0c1320c77cc1176d548f998136c03651329a92f7e6c4ba083521d Jul 20 04:44:22.659856 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.659825 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" event={"ID":"15097630-68a6-4704-9c96-2c619c3a76da","Type":"ContainerStarted","Data":"96d0363146cdad0f60a83ff8d7a62edee8a92c3fcc643572eefb2c0af0fededf"} Jul 20 04:44:22.660928 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.660904 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2" event={"ID":"dbba446d-f98d-4e41-8e02-7c03f5391120","Type":"ContainerStarted","Data":"bd74b18394b8b30bf9924e61a930e9996781763ec530f5037593665adb21d987"} Jul 20 04:44:22.661950 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.661931 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jcd8d" event={"ID":"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc","Type":"ContainerStarted","Data":"0cb440587eb0c1320c77cc1176d548f998136c03651329a92f7e6c4ba083521d"} Jul 20 04:44:22.742853 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:22.742813 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:22.742996 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:22.742976 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 04:44:22.743057 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:22.742998 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dbc7645c-t6bts: secret "image-registry-tls" not found Jul 20 04:44:22.743057 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:22.743053 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls podName:8f96f4b0-6794-48f1-95f3-432895ebce03 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:23.743037162 +0000 UTC m=+265.574367268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls") pod "image-registry-76dbc7645c-t6bts" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03") : secret "image-registry-tls" not found Jul 20 04:44:23.752372 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:23.752339 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:23.752867 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:23.752532 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 04:44:23.752867 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:23.752556 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dbc7645c-t6bts: secret "image-registry-tls" not found Jul 20 04:44:23.752867 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:23.752625 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls podName:8f96f4b0-6794-48f1-95f3-432895ebce03 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:25.752604148 +0000 UTC m=+267.583934234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls") pod "image-registry-76dbc7645c-t6bts" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03") : secret "image-registry-tls" not found Jul 20 04:44:25.673340 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.673224 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2" event={"ID":"dbba446d-f98d-4e41-8e02-7c03f5391120","Type":"ContainerStarted","Data":"0215e7d52cc067e656787172a46230931c7b0f75b0f9443826b93169365adbf5"} Jul 20 04:44:25.674840 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.674815 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jcd8d" event={"ID":"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc","Type":"ContainerStarted","Data":"6b7bb09d9ba693e258a7b499de5c6c2d3e55559205d092e243fe0f791584eb85"} Jul 20 04:44:25.676342 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.676321 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/0.log" Jul 20 04:44:25.676444 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.676361 2553 generic.go:356] "Generic (PLEG): container finished" podID="15097630-68a6-4704-9c96-2c619c3a76da" containerID="5fab315d3ad6f46730548b090253e7991ebafd5a29634f30beb83184fc9e9c51" exitCode=255 Jul 20 04:44:25.676444 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.676415 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" event={"ID":"15097630-68a6-4704-9c96-2c619c3a76da","Type":"ContainerDied","Data":"5fab315d3ad6f46730548b090253e7991ebafd5a29634f30beb83184fc9e9c51"} Jul 20 04:44:25.676633 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.676618 2553 scope.go:117] "RemoveContainer" containerID="5fab315d3ad6f46730548b090253e7991ebafd5a29634f30beb83184fc9e9c51" Jul 20 04:44:25.686972 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.686917 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p5lq2" podStartSLOduration=2.352575582 podStartE2EDuration="3.686901072s" totalImagesPullingTime="1.33432549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:44:25.686819644 +0000 UTC m=+267.518149750" watchObservedRunningTime="2026-07-20 04:44:25.686901072 +0000 UTC m=+267.518231179" Jul 20 04:44:25.719701 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.719656 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-jcd8d" podStartSLOduration=1.4369956369999999 podStartE2EDuration="3.719635743s" totalImagesPullingTime="2.282640106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:44:25.719080638 +0000 UTC m=+267.550410744" watchObservedRunningTime="2026-07-20 04:44:25.719635743 +0000 UTC m=+267.550965847" Jul 20 04:44:25.771988 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.771929 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:25.772368 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:25.772345 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 04:44:25.772368 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:25.772370 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dbc7645c-t6bts: secret "image-registry-tls" not found Jul 20 04:44:25.772547 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:25.772434 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls podName:8f96f4b0-6794-48f1-95f3-432895ebce03 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:29.772411612 +0000 UTC m=+271.603741708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls") pod "image-registry-76dbc7645c-t6bts" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03") : secret "image-registry-tls" not found Jul 20 04:44:25.775711 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.775676 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nmc5h"] Jul 20 04:44:25.778906 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.778887 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.781228 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.781200 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 04:44:25.781481 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.781459 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hd46p\"" Jul 20 04:44:25.782500 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.782398 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 04:44:25.793794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.793771 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nmc5h"] Jul 20 04:44:25.873357 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.873294 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/419317e6-5dae-461c-a772-456b0e87a3b3-data-volume\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.873357 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.873360 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.873541 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.873420 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.873541 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.873487 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z97f\" (UniqueName: \"kubernetes.io/projected/419317e6-5dae-461c-a772-456b0e87a3b3-kube-api-access-4z97f\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.873541 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.873534 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/419317e6-5dae-461c-a772-456b0e87a3b3-crio-socket\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.974552 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.974464 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/419317e6-5dae-461c-a772-456b0e87a3b3-data-volume\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.974552 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.974503 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.974552 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.974522 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.974785 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.974566 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z97f\" (UniqueName: \"kubernetes.io/projected/419317e6-5dae-461c-a772-456b0e87a3b3-kube-api-access-4z97f\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.974785 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:25.974599 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 04:44:25.974785 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:25.974701 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:26.474678013 +0000 UTC m=+268.306008101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : configmap "kube-rbac-proxy" not found Jul 20 04:44:25.974785 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:25.974700 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 04:44:25.974785 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.974609 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/419317e6-5dae-461c-a772-456b0e87a3b3-crio-socket\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.974785 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.974756 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/419317e6-5dae-461c-a772-456b0e87a3b3-crio-socket\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.974785 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:25.974761 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:26.474743863 +0000 UTC m=+268.306073961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : secret "insights-runtime-extractor-tls" not found Jul 20 04:44:25.975116 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.974890 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/419317e6-5dae-461c-a772-456b0e87a3b3-data-volume\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:25.985455 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:25.985423 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z97f\" (UniqueName: \"kubernetes.io/projected/419317e6-5dae-461c-a772-456b0e87a3b3-kube-api-access-4z97f\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:26.477878 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:26.477816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:26.477878 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:26.477882 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:26.478123 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:26.477951 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 04:44:26.478123 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:26.478022 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:27.478006147 +0000 UTC m=+269.309336231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : configmap "kube-rbac-proxy" not found Jul 20 04:44:26.478123 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:26.478051 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 04:44:26.478123 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:26.478118 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:27.478103458 +0000 UTC m=+269.309433541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : secret "insights-runtime-extractor-tls" not found Jul 20 04:44:26.681553 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:26.681521 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/1.log" Jul 20 04:44:26.681967 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:26.681929 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/0.log" Jul 20 04:44:26.682024 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:26.681972 2553 generic.go:356] "Generic (PLEG): container finished" podID="15097630-68a6-4704-9c96-2c619c3a76da" containerID="6d3fecbc379e374dc5479fcf8c9f58ba557706e24113a9c879465821a3900663" exitCode=255 Jul 20 04:44:26.682099 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:26.682038 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" event={"ID":"15097630-68a6-4704-9c96-2c619c3a76da","Type":"ContainerDied","Data":"6d3fecbc379e374dc5479fcf8c9f58ba557706e24113a9c879465821a3900663"} Jul 20 04:44:26.682099 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:26.682090 2553 scope.go:117] "RemoveContainer" containerID="5fab315d3ad6f46730548b090253e7991ebafd5a29634f30beb83184fc9e9c51" Jul 20 04:44:26.682545 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:26.682522 2553 scope.go:117] "RemoveContainer" containerID="6d3fecbc379e374dc5479fcf8c9f58ba557706e24113a9c879465821a3900663" Jul 20 04:44:26.682676 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:26.682662 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bfgpv_openshift-console-operator(15097630-68a6-4704-9c96-2c619c3a76da)\"" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podUID="15097630-68a6-4704-9c96-2c619c3a76da" Jul 20 04:44:27.485575 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:27.485537 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:27.485867 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:27.485644 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:27.485867 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:27.485691 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 04:44:27.485867 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:27.485711 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 04:44:27.485867 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:27.485761 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:29.485745182 +0000 UTC m=+271.317075265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : secret "insights-runtime-extractor-tls" not found Jul 20 04:44:27.485867 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:27.485775 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:29.485768912 +0000 UTC m=+271.317098994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : configmap "kube-rbac-proxy" not found Jul 20 04:44:27.686284 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:27.686257 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/1.log" Jul 20 04:44:27.686744 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:27.686683 2553 scope.go:117] "RemoveContainer" containerID="6d3fecbc379e374dc5479fcf8c9f58ba557706e24113a9c879465821a3900663" Jul 20 04:44:27.686841 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:27.686822 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bfgpv_openshift-console-operator(15097630-68a6-4704-9c96-2c619c3a76da)\"" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podUID="15097630-68a6-4704-9c96-2c619c3a76da" Jul 20 04:44:27.747302 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:27.747224 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzb5h_827bf049-ea44-42b4-b2b3-ea4f2c141dda/dns-node-resolver/0.log" Jul 20 04:44:28.527199 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.527164 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-n8mtw"] Jul 20 04:44:28.531591 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.531574 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.533705 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.533682 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 20 04:44:28.533825 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.533713 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 20 04:44:28.533825 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.533739 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 20 04:44:28.534754 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.534734 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 20 04:44:28.534904 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.534799 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zjtwb\"" Jul 20 04:44:28.536190 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.536166 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-n8mtw"] Jul 20 04:44:28.548588 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.548567 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5t9gn_eac9bab1-d00f-4b62-be3c-da339ba1c9b2/node-ca/0.log" Jul 20 04:44:28.692750 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.692709 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4931160a-a6d9-4b20-a6d0-93f8bd1e7faa-signing-cabundle\") pod \"service-ca-58598695f7-n8mtw\" (UID: \"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa\") " pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.693144 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.692867 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4931160a-a6d9-4b20-a6d0-93f8bd1e7faa-signing-key\") pod \"service-ca-58598695f7-n8mtw\" (UID: \"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa\") " pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.693144 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.692910 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzhp7\" (UniqueName: \"kubernetes.io/projected/4931160a-a6d9-4b20-a6d0-93f8bd1e7faa-kube-api-access-tzhp7\") pod \"service-ca-58598695f7-n8mtw\" (UID: \"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa\") " pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.794121 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.794031 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4931160a-a6d9-4b20-a6d0-93f8bd1e7faa-signing-key\") pod \"service-ca-58598695f7-n8mtw\" (UID: \"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa\") " pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.794121 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.794077 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzhp7\" (UniqueName: \"kubernetes.io/projected/4931160a-a6d9-4b20-a6d0-93f8bd1e7faa-kube-api-access-tzhp7\") pod \"service-ca-58598695f7-n8mtw\" (UID: \"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa\") " pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.794121 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.794101 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4931160a-a6d9-4b20-a6d0-93f8bd1e7faa-signing-cabundle\") pod \"service-ca-58598695f7-n8mtw\" (UID: \"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa\") " pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.794789 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.794771 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4931160a-a6d9-4b20-a6d0-93f8bd1e7faa-signing-cabundle\") pod \"service-ca-58598695f7-n8mtw\" (UID: \"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa\") " pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.796547 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.796530 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4931160a-a6d9-4b20-a6d0-93f8bd1e7faa-signing-key\") pod \"service-ca-58598695f7-n8mtw\" (UID: \"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa\") " pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.801788 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.801770 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzhp7\" (UniqueName: \"kubernetes.io/projected/4931160a-a6d9-4b20-a6d0-93f8bd1e7faa-kube-api-access-tzhp7\") pod \"service-ca-58598695f7-n8mtw\" (UID: \"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa\") " pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.841843 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.841810 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-n8mtw" Jul 20 04:44:28.967263 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:28.967230 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-n8mtw"] Jul 20 04:44:28.971331 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:44:28.971290 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4931160a_a6d9_4b20_a6d0_93f8bd1e7faa.slice/crio-139f7a36ab675ba192220f20ed84e03e82850e26246bdf49b5fe08872d9dd6f7 WatchSource:0}: Error finding container 139f7a36ab675ba192220f20ed84e03e82850e26246bdf49b5fe08872d9dd6f7: Status 404 returned error can't find the container with id 139f7a36ab675ba192220f20ed84e03e82850e26246bdf49b5fe08872d9dd6f7 Jul 20 04:44:29.347646 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:29.347615 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84bb8_5265bc55-f1c7-4009-bd94-8e52da59a793/serve-healthcheck-canary/0.log" Jul 20 04:44:29.499623 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:29.499581 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:29.499820 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:29.499635 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:29.499820 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:29.499732 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 04:44:29.499820 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:29.499768 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 04:44:29.499966 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:29.499829 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:33.499805531 +0000 UTC m=+275.331135614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : configmap "kube-rbac-proxy" not found Jul 20 04:44:29.499966 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:29.499849 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:33.499840512 +0000 UTC m=+275.331170604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : secret "insights-runtime-extractor-tls" not found Jul 20 04:44:29.694685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:29.694594 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-n8mtw" event={"ID":"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa","Type":"ContainerStarted","Data":"139f7a36ab675ba192220f20ed84e03e82850e26246bdf49b5fe08872d9dd6f7"} Jul 20 04:44:29.803292 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:29.803256 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:29.803482 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:29.803437 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 04:44:29.803482 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:29.803458 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76dbc7645c-t6bts: secret "image-registry-tls" not found Jul 20 04:44:29.803605 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:29.803524 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls podName:8f96f4b0-6794-48f1-95f3-432895ebce03 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:37.803504794 +0000 UTC m=+279.634834897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls") pod "image-registry-76dbc7645c-t6bts" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03") : secret "image-registry-tls" not found Jul 20 04:44:30.702855 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:30.702820 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-n8mtw" event={"ID":"4931160a-a6d9-4b20-a6d0-93f8bd1e7faa","Type":"ContainerStarted","Data":"32be48ec67887c5f206554e957081a78f1dfdb186b6743ec03cb55ae452888ef"} Jul 20 04:44:30.717466 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:30.717415 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-n8mtw" podStartSLOduration=1.096361324 podStartE2EDuration="2.717400825s" totalImagesPullingTime="1.621039501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:44:30.716040429 +0000 UTC m=+272.547370535" watchObservedRunningTime="2026-07-20 04:44:30.717400825 +0000 UTC m=+272.548730930" Jul 20 04:44:32.460139 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:32.460098 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:32.460645 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:32.460172 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:32.460645 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:32.460629 2553 scope.go:117] "RemoveContainer" containerID="6d3fecbc379e374dc5479fcf8c9f58ba557706e24113a9c879465821a3900663" Jul 20 04:44:32.460856 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:32.460830 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bfgpv_openshift-console-operator(15097630-68a6-4704-9c96-2c619c3a76da)\"" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podUID="15097630-68a6-4704-9c96-2c619c3a76da" Jul 20 04:44:33.537454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:33.537416 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:33.537454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:33.537457 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:33.537971 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:33.537561 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 04:44:33.537971 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:33.537601 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 04:44:33.537971 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:33.537651 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:41.537628192 +0000 UTC m=+283.368958294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : configmap "kube-rbac-proxy" not found Jul 20 04:44:33.537971 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:33.537672 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:41.537662135 +0000 UTC m=+283.368992223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : secret "insights-runtime-extractor-tls" not found Jul 20 04:44:37.874107 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:37.874062 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:37.876584 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:37.876563 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") pod \"image-registry-76dbc7645c-t6bts\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:37.969863 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:37.969832 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:38.105702 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:38.105671 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76dbc7645c-t6bts"] Jul 20 04:44:38.111065 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:44:38.111036 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f96f4b0_6794_48f1_95f3_432895ebce03.slice/crio-c865d6de2529740183ed3de7015cb680e569d0abb9c8bab5cf9dad1a475c3696 WatchSource:0}: Error finding container c865d6de2529740183ed3de7015cb680e569d0abb9c8bab5cf9dad1a475c3696: Status 404 returned error can't find the container with id c865d6de2529740183ed3de7015cb680e569d0abb9c8bab5cf9dad1a475c3696 Jul 20 04:44:38.731466 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:38.731429 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" event={"ID":"8f96f4b0-6794-48f1-95f3-432895ebce03","Type":"ContainerStarted","Data":"97a5bedb123acd5ee6e7ae26524e44dc1273311bd9844864c6dffd7c5e8deacf"} Jul 20 04:44:38.731649 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:38.731484 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" event={"ID":"8f96f4b0-6794-48f1-95f3-432895ebce03","Type":"ContainerStarted","Data":"c865d6de2529740183ed3de7015cb680e569d0abb9c8bab5cf9dad1a475c3696"} Jul 20 04:44:38.731649 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:38.731556 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:38.748803 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:38.748752 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" podStartSLOduration=16.748736117 podStartE2EDuration="16.748736117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:44:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:44:38.747412026 +0000 UTC m=+280.578742130" watchObservedRunningTime="2026-07-20 04:44:38.748736117 +0000 UTC m=+280.580066221" Jul 20 04:44:40.380178 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:40.380134 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z7z4r" podUID="a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8" Jul 20 04:44:40.737100 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:40.737015 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7z4r" Jul 20 04:44:41.602149 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:41.602109 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:41.602149 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:41.602153 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:41.602595 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:41.602294 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 04:44:41.602595 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:41.602379 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls podName:419317e6-5dae-461c-a772-456b0e87a3b3 nodeName:}" failed. No retries permitted until 2026-07-20 04:44:57.602361799 +0000 UTC m=+299.433691883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmc5h" (UID: "419317e6-5dae-461c-a772-456b0e87a3b3") : secret "insights-runtime-extractor-tls" not found Jul 20 04:44:41.602673 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:41.602637 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/419317e6-5dae-461c-a772-456b0e87a3b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:43.519026 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:43.518987 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:44:43.521374 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:43.521356 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8-metrics-tls\") pod \"dns-default-z7z4r\" (UID: \"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8\") " pod="openshift-dns/dns-default-z7z4r" Jul 20 04:44:43.740529 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:43.740498 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wnw2z\"" Jul 20 04:44:43.749280 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:43.749250 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7z4r" Jul 20 04:44:43.877569 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:43.877538 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7z4r"] Jul 20 04:44:43.880432 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:44:43.880407 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5bc31fe_d6e7_4a9c_b031_6e0526fa32b8.slice/crio-c9e2e3efe851b03270a8740de6d942ca3c611616eb8ca8730b43c1861d0df7b7 WatchSource:0}: Error finding container c9e2e3efe851b03270a8740de6d942ca3c611616eb8ca8730b43c1861d0df7b7: Status 404 returned error can't find the container with id c9e2e3efe851b03270a8740de6d942ca3c611616eb8ca8730b43c1861d0df7b7 Jul 20 04:44:44.752380 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:44.752340 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7z4r" event={"ID":"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8","Type":"ContainerStarted","Data":"c9e2e3efe851b03270a8740de6d942ca3c611616eb8ca8730b43c1861d0df7b7"} Jul 20 04:44:45.757721 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:45.757638 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7z4r" event={"ID":"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8","Type":"ContainerStarted","Data":"9728b598c92e3aa55c086ed82a1de93712755cb778f5c1098c32409a7002e946"} Jul 20 04:44:45.757721 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:45.757691 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7z4r" event={"ID":"a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8","Type":"ContainerStarted","Data":"4925ce78cd7540eb0b42f5ce6e8467086419442f1cb58d5d28fe671fb8075dd1"} Jul 20 04:44:45.758089 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:45.757773 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z7z4r" Jul 20 04:44:45.774903 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:45.774855 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z7z4r" podStartSLOduration=251.261822421 podStartE2EDuration="4m12.774837244s" totalImagesPullingTime="1.513014823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:44:45.773083244 +0000 UTC m=+287.604413348" watchObservedRunningTime="2026-07-20 04:44:45.774837244 +0000 UTC m=+287.606167349" Jul 20 04:44:47.692188 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:47.692148 2553 scope.go:117] "RemoveContainer" containerID="6d3fecbc379e374dc5479fcf8c9f58ba557706e24113a9c879465821a3900663" Jul 20 04:44:47.766160 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:47.766136 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/1.log" Jul 20 04:44:47.766343 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:47.766219 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" event={"ID":"15097630-68a6-4704-9c96-2c619c3a76da","Type":"ContainerStarted","Data":"e5872e5b79c0074ca41c0ec6039c64a1c4e694228d9aed98a4b830d4eaad6391"} Jul 20 04:44:47.766607 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:47.766573 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:47.767858 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:47.767833 2553 patch_prober.go:28] interesting pod/console-operator-565b7b569d-bfgpv container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.11:8443/readyz\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jul 20 04:44:47.767930 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:47.767887 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podUID="15097630-68a6-4704-9c96-2c619c3a76da" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.11:8443/readyz\": dial tcp 10.134.0.11:8443: connect: connection refused" Jul 20 04:44:47.782387 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:47.782324 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podStartSLOduration=23.477233979 podStartE2EDuration="25.782284913s" totalImagesPullingTime="2.305050934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:44:47.780799249 +0000 UTC m=+289.612129355" watchObservedRunningTime="2026-07-20 04:44:47.782284913 +0000 UTC m=+289.613615021" Jul 20 04:44:48.770371 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:48.770341 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:44:48.770774 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:48.770694 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/1.log" Jul 20 04:44:48.770774 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:48.770724 2553 generic.go:356] "Generic (PLEG): container finished" podID="15097630-68a6-4704-9c96-2c619c3a76da" containerID="e5872e5b79c0074ca41c0ec6039c64a1c4e694228d9aed98a4b830d4eaad6391" exitCode=255 Jul 20 04:44:48.770774 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:48.770756 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" event={"ID":"15097630-68a6-4704-9c96-2c619c3a76da","Type":"ContainerDied","Data":"e5872e5b79c0074ca41c0ec6039c64a1c4e694228d9aed98a4b830d4eaad6391"} Jul 20 04:44:48.770928 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:48.770812 2553 scope.go:117] "RemoveContainer" containerID="6d3fecbc379e374dc5479fcf8c9f58ba557706e24113a9c879465821a3900663" Jul 20 04:44:48.771090 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:48.771071 2553 scope.go:117] "RemoveContainer" containerID="e5872e5b79c0074ca41c0ec6039c64a1c4e694228d9aed98a4b830d4eaad6391" Jul 20 04:44:48.771272 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:48.771251 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bfgpv_openshift-console-operator(15097630-68a6-4704-9c96-2c619c3a76da)\"" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podUID="15097630-68a6-4704-9c96-2c619c3a76da" Jul 20 04:44:49.747140 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.747099 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76dbc7645c-t6bts"] Jul 20 04:44:49.775524 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.775497 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:44:49.775875 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.775828 2553 scope.go:117] "RemoveContainer" containerID="e5872e5b79c0074ca41c0ec6039c64a1c4e694228d9aed98a4b830d4eaad6391" Jul 20 04:44:49.775995 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:49.775974 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bfgpv_openshift-console-operator(15097630-68a6-4704-9c96-2c619c3a76da)\"" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podUID="15097630-68a6-4704-9c96-2c619c3a76da" Jul 20 04:44:49.778494 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.778470 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5564b67776-xjd7x"] Jul 20 04:44:49.781291 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.781274 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:49.793204 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.793180 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5564b67776-xjd7x"] Jul 20 04:44:49.969044 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.969009 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/baed8a99-889c-4d2f-9608-f0089d6f16df-image-registry-private-configuration\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:49.969044 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.969041 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baed8a99-889c-4d2f-9608-f0089d6f16df-trusted-ca\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:49.969251 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.969168 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/baed8a99-889c-4d2f-9608-f0089d6f16df-installation-pull-secrets\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:49.969251 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.969215 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baed8a99-889c-4d2f-9608-f0089d6f16df-bound-sa-token\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:49.969251 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.969247 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/baed8a99-889c-4d2f-9608-f0089d6f16df-registry-tls\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:49.969370 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.969269 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/baed8a99-889c-4d2f-9608-f0089d6f16df-ca-trust-extracted\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:49.969405 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.969375 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g26b9\" (UniqueName: \"kubernetes.io/projected/baed8a99-889c-4d2f-9608-f0089d6f16df-kube-api-access-g26b9\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:49.969442 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:49.969410 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/baed8a99-889c-4d2f-9608-f0089d6f16df-registry-certificates\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.069939 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.069847 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/baed8a99-889c-4d2f-9608-f0089d6f16df-image-registry-private-configuration\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.069939 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.069885 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baed8a99-889c-4d2f-9608-f0089d6f16df-trusted-ca\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.069939 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.069936 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/baed8a99-889c-4d2f-9608-f0089d6f16df-installation-pull-secrets\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.070223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.070105 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baed8a99-889c-4d2f-9608-f0089d6f16df-bound-sa-token\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.070223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.070148 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/baed8a99-889c-4d2f-9608-f0089d6f16df-registry-tls\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.070223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.070176 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/baed8a99-889c-4d2f-9608-f0089d6f16df-ca-trust-extracted\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.070223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.070221 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g26b9\" (UniqueName: \"kubernetes.io/projected/baed8a99-889c-4d2f-9608-f0089d6f16df-kube-api-access-g26b9\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.070462 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.070258 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/baed8a99-889c-4d2f-9608-f0089d6f16df-registry-certificates\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.070732 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.070703 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/baed8a99-889c-4d2f-9608-f0089d6f16df-ca-trust-extracted\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.071038 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.071013 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/baed8a99-889c-4d2f-9608-f0089d6f16df-trusted-ca\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.071301 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.071279 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/baed8a99-889c-4d2f-9608-f0089d6f16df-registry-certificates\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.072562 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.072534 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/baed8a99-889c-4d2f-9608-f0089d6f16df-image-registry-private-configuration\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.072684 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.072664 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/baed8a99-889c-4d2f-9608-f0089d6f16df-installation-pull-secrets\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.072911 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.072896 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/baed8a99-889c-4d2f-9608-f0089d6f16df-registry-tls\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.077564 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.077539 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g26b9\" (UniqueName: \"kubernetes.io/projected/baed8a99-889c-4d2f-9608-f0089d6f16df-kube-api-access-g26b9\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.077650 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.077620 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baed8a99-889c-4d2f-9608-f0089d6f16df-bound-sa-token\") pod \"image-registry-5564b67776-xjd7x\" (UID: \"baed8a99-889c-4d2f-9608-f0089d6f16df\") " pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.089533 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.089508 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.220332 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.220278 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5564b67776-xjd7x"] Jul 20 04:44:50.223212 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:44:50.223182 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaed8a99_889c_4d2f_9608_f0089d6f16df.slice/crio-ffa9b82ec53fe34b249f08285ddae1486e96970cef6df90d992c0e0262f0c03f WatchSource:0}: Error finding container ffa9b82ec53fe34b249f08285ddae1486e96970cef6df90d992c0e0262f0c03f: Status 404 returned error can't find the container with id ffa9b82ec53fe34b249f08285ddae1486e96970cef6df90d992c0e0262f0c03f Jul 20 04:44:50.780185 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.780143 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5564b67776-xjd7x" event={"ID":"baed8a99-889c-4d2f-9608-f0089d6f16df","Type":"ContainerStarted","Data":"1c122442869e022c6e34de2213f83236d7cfba086a3ad38ce678b9f18ead1401"} Jul 20 04:44:50.780185 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.780192 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5564b67776-xjd7x" event={"ID":"baed8a99-889c-4d2f-9608-f0089d6f16df","Type":"ContainerStarted","Data":"ffa9b82ec53fe34b249f08285ddae1486e96970cef6df90d992c0e0262f0c03f"} Jul 20 04:44:50.780649 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.780221 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:44:50.796501 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:50.796452 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5564b67776-xjd7x" podStartSLOduration=1.796438222 podStartE2EDuration="1.796438222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:44:50.796072393 +0000 UTC m=+292.627402495" watchObservedRunningTime="2026-07-20 04:44:50.796438222 +0000 UTC m=+292.627768325" Jul 20 04:44:52.460693 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:52.460653 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:44:52.461083 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:52.461070 2553 scope.go:117] "RemoveContainer" containerID="e5872e5b79c0074ca41c0ec6039c64a1c4e694228d9aed98a4b830d4eaad6391" Jul 20 04:44:52.461251 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:52.461231 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bfgpv_openshift-console-operator(15097630-68a6-4704-9c96-2c619c3a76da)\"" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podUID="15097630-68a6-4704-9c96-2c619c3a76da" Jul 20 04:44:55.693436 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:55.693395 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-v84j5" podUID="3673a269-04f3-4369-9467-fea04e2ddf96" Jul 20 04:44:55.762841 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:55.762812 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z7z4r" Jul 20 04:44:57.625421 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:57.625379 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:57.627821 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:57.627800 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/419317e6-5dae-461c-a772-456b0e87a3b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmc5h\" (UID: \"419317e6-5dae-461c-a772-456b0e87a3b3\") " pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:57.890180 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:57.890096 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nmc5h" Jul 20 04:44:58.030924 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:58.030891 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nmc5h"] Jul 20 04:44:58.034481 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:44:58.034449 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419317e6_5dae_461c_a772_456b0e87a3b3.slice/crio-5c7fb8e5060a2605634355c1531d9c9142e31cc8283622eabe71b3674e6581fe WatchSource:0}: Error finding container 5c7fb8e5060a2605634355c1531d9c9142e31cc8283622eabe71b3674e6581fe: Status 404 returned error can't find the container with id 5c7fb8e5060a2605634355c1531d9c9142e31cc8283622eabe71b3674e6581fe Jul 20 04:44:58.614927 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:58.614862 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:44:58.619217 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:58.619191 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:44:58.634108 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:58.634081 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:44:58.635003 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:58.634979 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:44:58.643792 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:58.643775 2553 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 04:44:58.807595 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:58.807424 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmc5h" event={"ID":"419317e6-5dae-461c-a772-456b0e87a3b3","Type":"ContainerStarted","Data":"5c7fb8e5060a2605634355c1531d9c9142e31cc8283622eabe71b3674e6581fe"} Jul 20 04:44:59.555981 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.555945 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tgggx"] Jul 20 04:44:59.574710 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.574667 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tgggx"] Jul 20 04:44:59.574887 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.574777 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.577491 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.577286 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 04:44:59.577491 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.577334 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 20 04:44:59.577491 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.577369 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 20 04:44:59.577752 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.577645 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 04:44:59.577752 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.577679 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dfpr9\"" Jul 20 04:44:59.578338 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.578298 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 04:44:59.645745 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.645711 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/340745fa-e6a1-4c3f-b684-a8de32d99ee2-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.646172 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.645811 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.646172 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.645843 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-865sv\" (UniqueName: \"kubernetes.io/projected/340745fa-e6a1-4c3f-b684-a8de32d99ee2-kube-api-access-865sv\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.646172 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.645897 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.746927 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.746890 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.746927 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.746929 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-865sv\" (UniqueName: \"kubernetes.io/projected/340745fa-e6a1-4c3f-b684-a8de32d99ee2-kube-api-access-865sv\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.747178 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.746953 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.747178 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.747025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/340745fa-e6a1-4c3f-b684-a8de32d99ee2-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.747178 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:59.747060 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 20 04:44:59.747178 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:44:59.747133 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-tls podName:340745fa-e6a1-4c3f-b684-a8de32d99ee2 nodeName:}" failed. No retries permitted until 2026-07-20 04:45:00.247114561 +0000 UTC m=+302.078444655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-tgggx" (UID: "340745fa-e6a1-4c3f-b684-a8de32d99ee2") : secret "prometheus-operator-tls" not found Jul 20 04:44:59.747836 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.747788 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/340745fa-e6a1-4c3f-b684-a8de32d99ee2-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.750168 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.750126 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:44:59.753900 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.753879 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:44:59.756190 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:44:59.756164 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-865sv\" (UniqueName: \"kubernetes.io/projected/340745fa-e6a1-4c3f-b684-a8de32d99ee2-kube-api-access-865sv\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:45:00.252622 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:00.252583 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:45:00.252818 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:45:00.252770 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 20 04:45:00.252879 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:45:00.252849 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-tls podName:340745fa-e6a1-4c3f-b684-a8de32d99ee2 nodeName:}" failed. No retries permitted until 2026-07-20 04:45:01.252826278 +0000 UTC m=+303.084156384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-tgggx" (UID: "340745fa-e6a1-4c3f-b684-a8de32d99ee2") : secret "prometheus-operator-tls" not found Jul 20 04:45:01.260748 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:01.260705 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:45:01.263647 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:01.263619 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/340745fa-e6a1-4c3f-b684-a8de32d99ee2-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tgggx\" (UID: \"340745fa-e6a1-4c3f-b684-a8de32d99ee2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:45:01.386423 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:01.386376 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" Jul 20 04:45:03.089063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:03.089037 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tgggx"] Jul 20 04:45:03.091880 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:45:03.091851 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340745fa_e6a1_4c3f_b684_a8de32d99ee2.slice/crio-ee501437ec8eaa81ea2cdcdcc78588d3c5d8d63e0fd4d353b2940daebdb8dc54 WatchSource:0}: Error finding container ee501437ec8eaa81ea2cdcdcc78588d3c5d8d63e0fd4d353b2940daebdb8dc54: Status 404 returned error can't find the container with id ee501437ec8eaa81ea2cdcdcc78588d3c5d8d63e0fd4d353b2940daebdb8dc54 Jul 20 04:45:03.093965 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:03.093945 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 04:45:03.692124 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:03.692093 2553 scope.go:117] "RemoveContainer" containerID="e5872e5b79c0074ca41c0ec6039c64a1c4e694228d9aed98a4b830d4eaad6391" Jul 20 04:45:03.692402 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:45:03.692376 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bfgpv_openshift-console-operator(15097630-68a6-4704-9c96-2c619c3a76da)\"" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podUID="15097630-68a6-4704-9c96-2c619c3a76da" Jul 20 04:45:03.829023 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:03.828979 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" event={"ID":"340745fa-e6a1-4c3f-b684-a8de32d99ee2","Type":"ContainerStarted","Data":"ee501437ec8eaa81ea2cdcdcc78588d3c5d8d63e0fd4d353b2940daebdb8dc54"} Jul 20 04:45:03.830753 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:03.830721 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmc5h" event={"ID":"419317e6-5dae-461c-a772-456b0e87a3b3","Type":"ContainerStarted","Data":"d69b8e1ecd7237471ebf2a9f8693ac97c0fb23d50d04ff7d925cd231173c11e0"} Jul 20 04:45:06.691450 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:06.691425 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:45:06.847065 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:06.846958 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" event={"ID":"340745fa-e6a1-4c3f-b684-a8de32d99ee2","Type":"ContainerStarted","Data":"687f2cae1f2cb44ff2e1200761a7ebe3985426d566ed08bea1271ec045d66a94"} Jul 20 04:45:06.847065 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:06.847027 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" event={"ID":"340745fa-e6a1-4c3f-b684-a8de32d99ee2","Type":"ContainerStarted","Data":"3d1baa1acc9a8572a6026c4fc3679da4a313a46f94bbaa0e5cb01adb2125cd8a"} Jul 20 04:45:06.849183 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:06.849141 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmc5h" event={"ID":"419317e6-5dae-461c-a772-456b0e87a3b3","Type":"ContainerStarted","Data":"095bf3012a50c509474798a7b1ad65dfd638d88d7c8e4e66b48543f2d7c1eae6"} Jul 20 04:45:06.866613 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:06.866516 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tgggx" podStartSLOduration=4.35608997 podStartE2EDuration="7.866500084s" totalImagesPullingTime="3.510410114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:45:06.864839588 +0000 UTC m=+308.696169693" watchObservedRunningTime="2026-07-20 04:45:06.866500084 +0000 UTC m=+308.697830188" Jul 20 04:45:08.924006 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:08.923967 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mhbm6"] Jul 20 04:45:08.934903 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:08.934871 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:08.937389 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:08.937367 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 04:45:08.937916 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:08.937516 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 04:45:08.937916 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:08.937625 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-49tq4\"" Jul 20 04:45:08.937916 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:08.937761 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 04:45:09.036193 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.036150 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-sys\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.036394 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.036208 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-metrics-client-ca\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.036394 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.036237 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-root\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.036394 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.036328 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-wtmp\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.036394 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.036391 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.036612 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.036412 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-tls\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.036612 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.036436 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-textfile\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.036612 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.036453 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqdp6\" (UniqueName: \"kubernetes.io/projected/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-kube-api-access-kqdp6\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.036612 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.036503 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.137763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137287 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.137763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137355 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-tls\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.137763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137406 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-textfile\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.137763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137431 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqdp6\" (UniqueName: \"kubernetes.io/projected/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-kube-api-access-kqdp6\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.137763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137490 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.137763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137528 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-sys\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.137763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137562 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-metrics-client-ca\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.137763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137590 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-root\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.137763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137632 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-wtmp\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.138301 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.137805 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-wtmp\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.138301 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:45:09.137909 2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 20 04:45:09.138301 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:45:09.137962 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-tls podName:43293703-fb24-46ae-8ad5-ec55ebbbf5a7 nodeName:}" failed. No retries permitted until 2026-07-20 04:45:09.637943585 +0000 UTC m=+311.469273675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-tls") pod "node-exporter-mhbm6" (UID: "43293703-fb24-46ae-8ad5-ec55ebbbf5a7") : secret "node-exporter-tls" not found Jul 20 04:45:09.138301 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.138390 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-sys\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.138301 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.138536 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-textfile\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.138301 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.138697 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-root\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.138301 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.138962 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.139441 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.139044 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-metrics-client-ca\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.145613 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.145590 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.149188 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.149162 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqdp6\" (UniqueName: \"kubernetes.io/projected/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-kube-api-access-kqdp6\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.642934 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.642898 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-tls\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.645753 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.645726 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43293703-fb24-46ae-8ad5-ec55ebbbf5a7-node-exporter-tls\") pod \"node-exporter-mhbm6\" (UID: \"43293703-fb24-46ae-8ad5-ec55ebbbf5a7\") " pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:09.847508 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:09.847472 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mhbm6" Jul 20 04:45:10.207358 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:45:10.207275 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43293703_fb24_46ae_8ad5_ec55ebbbf5a7.slice/crio-9ed4b45882a52fa460d5747d309803ec125c510c7d82d7c34a0e05fe19848389 WatchSource:0}: Error finding container 9ed4b45882a52fa460d5747d309803ec125c510c7d82d7c34a0e05fe19848389: Status 404 returned error can't find the container with id 9ed4b45882a52fa460d5747d309803ec125c510c7d82d7c34a0e05fe19848389 Jul 20 04:45:10.867689 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:10.867654 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhbm6" event={"ID":"43293703-fb24-46ae-8ad5-ec55ebbbf5a7","Type":"ContainerStarted","Data":"9ed4b45882a52fa460d5747d309803ec125c510c7d82d7c34a0e05fe19848389"} Jul 20 04:45:10.869958 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:10.869930 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmc5h" event={"ID":"419317e6-5dae-461c-a772-456b0e87a3b3","Type":"ContainerStarted","Data":"0ccb28e283d6c122fb8aeed227d8b2d26fa97dbefe0fb1a8e7a836894b1d6ba0"} Jul 20 04:45:10.890222 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:10.890172 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nmc5h" podStartSLOduration=33.811974483 podStartE2EDuration="45.890157112s" totalImagesPullingTime="12.078182629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:44:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:45:10.8887655 +0000 UTC m=+312.720095630" watchObservedRunningTime="2026-07-20 04:45:10.890157112 +0000 UTC m=+312.721487216" Jul 20 04:45:11.788350 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:11.788254 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5564b67776-xjd7x" Jul 20 04:45:11.875760 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:11.875727 2553 generic.go:356] "Generic (PLEG): container finished" podID="43293703-fb24-46ae-8ad5-ec55ebbbf5a7" containerID="b92e226576da9f362716a51ec8895f9a5d68f3b6f23f70ea6c65ddebc5b0fa06" exitCode=0 Jul 20 04:45:11.875938 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:11.875815 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhbm6" event={"ID":"43293703-fb24-46ae-8ad5-ec55ebbbf5a7","Type":"ContainerDied","Data":"b92e226576da9f362716a51ec8895f9a5d68f3b6f23f70ea6c65ddebc5b0fa06"} Jul 20 04:45:12.881513 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:12.881480 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhbm6" event={"ID":"43293703-fb24-46ae-8ad5-ec55ebbbf5a7","Type":"ContainerStarted","Data":"8f9c44fe4009e5dbf0211a016c7d4bbc6340aaefe2ee5edfa52b330fd9ab8d14"} Jul 20 04:45:12.881894 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:12.881530 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhbm6" event={"ID":"43293703-fb24-46ae-8ad5-ec55ebbbf5a7","Type":"ContainerStarted","Data":"1f125fcd3d7fc0b7e046317176f3662009c0d87b057d87463813ef8532489fcc"} Jul 20 04:45:12.901320 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:12.901250 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mhbm6" podStartSLOduration=3.650760041 podStartE2EDuration="4.901233967s" totalImagesPullingTime="1.177427105s" totalInitContainerRuntime="73.046821ms" isStatefulPod=true podCreationTimestamp="2026-07-20 04:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:45:12.89941271 +0000 UTC m=+314.730742815" watchObservedRunningTime="2026-07-20 04:45:12.901233967 +0000 UTC m=+314.732564123" Jul 20 04:45:13.668246 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.668216 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v"] Jul 20 04:45:13.671660 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.671639 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:13.673823 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.673801 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 20 04:45:13.673823 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.673813 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-klgb2\"" Jul 20 04:45:13.678534 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.678517 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v"] Jul 20 04:45:13.776267 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.776236 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26140700-09b3-408f-8890-c7288274a145-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-np29v\" (UID: \"26140700-09b3-408f-8890-c7288274a145\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:13.776482 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.776274 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x8jg\" (UniqueName: \"kubernetes.io/projected/26140700-09b3-408f-8890-c7288274a145-kube-api-access-6x8jg\") pod \"monitoring-plugin-7b7b7bc8bf-np29v\" (UID: \"26140700-09b3-408f-8890-c7288274a145\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:13.876994 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.876959 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26140700-09b3-408f-8890-c7288274a145-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-np29v\" (UID: \"26140700-09b3-408f-8890-c7288274a145\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:13.877159 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.877001 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x8jg\" (UniqueName: \"kubernetes.io/projected/26140700-09b3-408f-8890-c7288274a145-kube-api-access-6x8jg\") pod \"monitoring-plugin-7b7b7bc8bf-np29v\" (UID: \"26140700-09b3-408f-8890-c7288274a145\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:13.879578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.879547 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26140700-09b3-408f-8890-c7288274a145-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-np29v\" (UID: \"26140700-09b3-408f-8890-c7288274a145\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:13.884967 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.884941 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x8jg\" (UniqueName: \"kubernetes.io/projected/26140700-09b3-408f-8890-c7288274a145-kube-api-access-6x8jg\") pod \"monitoring-plugin-7b7b7bc8bf-np29v\" (UID: \"26140700-09b3-408f-8890-c7288274a145\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:13.982684 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:13.982608 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:14.118229 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:14.118196 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v"] Jul 20 04:45:14.121181 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:45:14.121152 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26140700_09b3_408f_8890_c7288274a145.slice/crio-28be3b5caee0a1226808f46209d5e7638a607ec295060bc58487d81803303bd8 WatchSource:0}: Error finding container 28be3b5caee0a1226808f46209d5e7638a607ec295060bc58487d81803303bd8: Status 404 returned error can't find the container with id 28be3b5caee0a1226808f46209d5e7638a607ec295060bc58487d81803303bd8 Jul 20 04:45:14.692089 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:14.692053 2553 scope.go:117] "RemoveContainer" containerID="e5872e5b79c0074ca41c0ec6039c64a1c4e694228d9aed98a4b830d4eaad6391" Jul 20 04:45:14.767533 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:14.767495 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" podUID="8f96f4b0-6794-48f1-95f3-432895ebce03" containerName="registry" containerID="cri-o://97a5bedb123acd5ee6e7ae26524e44dc1273311bd9844864c6dffd7c5e8deacf" gracePeriod=30 Jul 20 04:45:14.892182 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:14.892158 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:45:14.893348 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:14.892248 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" event={"ID":"15097630-68a6-4704-9c96-2c619c3a76da","Type":"ContainerStarted","Data":"ce89dcd1acdd44da6a442de387ca7a8331dea6ce32d1137d6c96a45ca47a82ba"} Jul 20 04:45:14.893348 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:14.893089 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:45:14.894152 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:14.894124 2553 generic.go:356] "Generic (PLEG): container finished" podID="8f96f4b0-6794-48f1-95f3-432895ebce03" containerID="97a5bedb123acd5ee6e7ae26524e44dc1273311bd9844864c6dffd7c5e8deacf" exitCode=0 Jul 20 04:45:14.894243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:14.894200 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" event={"ID":"8f96f4b0-6794-48f1-95f3-432895ebce03","Type":"ContainerDied","Data":"97a5bedb123acd5ee6e7ae26524e44dc1273311bd9844864c6dffd7c5e8deacf"} Jul 20 04:45:14.895597 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:14.895571 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" event={"ID":"26140700-09b3-408f-8890-c7288274a145","Type":"ContainerStarted","Data":"28be3b5caee0a1226808f46209d5e7638a607ec295060bc58487d81803303bd8"} Jul 20 04:45:15.040917 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.040889 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:45:15.089505 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.089464 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-trusted-ca\") pod \"8f96f4b0-6794-48f1-95f3-432895ebce03\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " Jul 20 04:45:15.089678 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.089519 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f96f4b0-6794-48f1-95f3-432895ebce03-ca-trust-extracted\") pod \"8f96f4b0-6794-48f1-95f3-432895ebce03\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " Jul 20 04:45:15.089678 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.089568 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-installation-pull-secrets\") pod \"8f96f4b0-6794-48f1-95f3-432895ebce03\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " Jul 20 04:45:15.089678 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.089617 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") pod \"8f96f4b0-6794-48f1-95f3-432895ebce03\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " Jul 20 04:45:15.089678 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.089648 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-image-registry-private-configuration\") pod \"8f96f4b0-6794-48f1-95f3-432895ebce03\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " Jul 20 04:45:15.089909 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.089685 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-certificates\") pod \"8f96f4b0-6794-48f1-95f3-432895ebce03\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " Jul 20 04:45:15.089909 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.089710 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clgz7\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-kube-api-access-clgz7\") pod \"8f96f4b0-6794-48f1-95f3-432895ebce03\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " Jul 20 04:45:15.089909 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.089790 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-bound-sa-token\") pod \"8f96f4b0-6794-48f1-95f3-432895ebce03\" (UID: \"8f96f4b0-6794-48f1-95f3-432895ebce03\") " Jul 20 04:45:15.090052 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.089980 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8f96f4b0-6794-48f1-95f3-432895ebce03" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:45:15.090510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.090466 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8f96f4b0-6794-48f1-95f3-432895ebce03" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:45:15.093281 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.093249 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8f96f4b0-6794-48f1-95f3-432895ebce03" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 04:45:15.094358 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.093972 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8f96f4b0-6794-48f1-95f3-432895ebce03" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:45:15.094358 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.094098 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-kube-api-access-clgz7" (OuterVolumeSpecName: "kube-api-access-clgz7") pod "8f96f4b0-6794-48f1-95f3-432895ebce03" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03"). InnerVolumeSpecName "kube-api-access-clgz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 04:45:15.094658 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.094627 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8f96f4b0-6794-48f1-95f3-432895ebce03" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:45:15.095647 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.095619 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f96f4b0-6794-48f1-95f3-432895ebce03" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 04:45:15.103667 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.102435 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f96f4b0-6794-48f1-95f3-432895ebce03-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8f96f4b0-6794-48f1-95f3-432895ebce03" (UID: "8f96f4b0-6794-48f1-95f3-432895ebce03"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 04:45:15.168272 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.168234 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 04:45:15.168643 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.168624 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f96f4b0-6794-48f1-95f3-432895ebce03" containerName="registry" Jul 20 04:45:15.168764 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.168646 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f96f4b0-6794-48f1-95f3-432895ebce03" containerName="registry" Jul 20 04:45:15.168764 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.168717 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f96f4b0-6794-48f1-95f3-432895ebce03" containerName="registry" Jul 20 04:45:15.176397 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.174484 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.178352 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.178298 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 04:45:15.178813 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.178749 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 04:45:15.179052 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.178979 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 04:45:15.179145 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179111 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 04:45:15.179235 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179142 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 04:45:15.179235 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179223 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5px2d\"" Jul 20 04:45:15.179391 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179366 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 04:45:15.179445 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179434 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 04:45:15.179517 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179442 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 04:45:15.179517 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179370 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 04:45:15.179702 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179642 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 04:45:15.179772 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179718 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 04:45:15.179824 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179774 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 04:45:15.179878 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179824 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bivai0fbcsk52\"" Jul 20 04:45:15.179962 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.179905 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 04:45:15.182955 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.180629 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 04:45:15.182955 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.182778 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 04:45:15.191907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.190756 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-bound-sa-token\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:45:15.191907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.190781 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-trusted-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:45:15.191907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.190817 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f96f4b0-6794-48f1-95f3-432895ebce03-ca-trust-extracted\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:45:15.191907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.190833 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-installation-pull-secrets\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:45:15.191907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.190847 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:45:15.191907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.190861 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f96f4b0-6794-48f1-95f3-432895ebce03-image-registry-private-configuration\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:45:15.191907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.190901 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f96f4b0-6794-48f1-95f3-432895ebce03-registry-certificates\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:45:15.191907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.190916 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clgz7\" (UniqueName: \"kubernetes.io/projected/8f96f4b0-6794-48f1-95f3-432895ebce03-kube-api-access-clgz7\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:45:15.192812 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.192787 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292252 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292330 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292364 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292394 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292436 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292472 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292510 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292545 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292566 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292597 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292620 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292648 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292676 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292725 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292763 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.293175 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292790 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.294063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292820 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.294063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292849 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.294063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292890 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.294063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.292922 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6d2b\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-kube-api-access-b6d2b\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.393978 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.393941 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394158 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.393999 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394158 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394031 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394158 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394062 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394158 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394093 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394158 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394120 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394158 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394149 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6d2b\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-kube-api-access-b6d2b\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394176 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394202 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394227 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394255 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394299 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394355 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394396 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394421 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394436 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394462 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.394492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394485 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.395010 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394525 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.395010 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.394557 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.395116 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.395038 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.395799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.395287 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.395995 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.395966 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.396678 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.396650 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.397490 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.397459 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.398986 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.398869 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.398986 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.398965 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.399191 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.399170 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.399255 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.399170 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.399362 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.399338 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.399592 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.399570 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.399837 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.399815 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.400156 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.400133 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.401834 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.401790 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.403421 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.403397 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.403976 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.403953 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.404701 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.404464 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.404701 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.404666 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6d2b\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-kube-api-access-b6d2b\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.405163 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.405141 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.406710 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.406680 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.490280 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.490238 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:15.893907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.893821 2553 patch_prober.go:28] interesting pod/console-operator-565b7b569d-bfgpv container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.11:8443/readyz\": context deadline exceeded" start-of-body= Jul 20 04:45:15.893907 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.893899 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" podUID="15097630-68a6-4704-9c96-2c619c3a76da" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.11:8443/readyz\": context deadline exceeded" Jul 20 04:45:15.902560 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.902537 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" Jul 20 04:45:15.902706 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.902539 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76dbc7645c-t6bts" event={"ID":"8f96f4b0-6794-48f1-95f3-432895ebce03","Type":"ContainerDied","Data":"c865d6de2529740183ed3de7015cb680e569d0abb9c8bab5cf9dad1a475c3696"} Jul 20 04:45:15.902706 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.902649 2553 scope.go:117] "RemoveContainer" containerID="97a5bedb123acd5ee6e7ae26524e44dc1273311bd9844864c6dffd7c5e8deacf" Jul 20 04:45:15.926853 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.926826 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76dbc7645c-t6bts"] Jul 20 04:45:15.930004 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.929981 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76dbc7645c-t6bts"] Jul 20 04:45:15.996572 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:15.996550 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 04:45:15.999296 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:45:15.999259 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f3c0bb_52a0_49ba_915b_ed7c70af92fc.slice/crio-e303878238bb27bf20a244fd8ad8378ea409291e2893e0b9a09bdab6c67d0c47 WatchSource:0}: Error finding container e303878238bb27bf20a244fd8ad8378ea409291e2893e0b9a09bdab6c67d0c47: Status 404 returned error can't find the container with id e303878238bb27bf20a244fd8ad8378ea409291e2893e0b9a09bdab6c67d0c47 Jul 20 04:45:16.113362 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:16.113259 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-bfgpv" Jul 20 04:45:16.697799 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:16.697761 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f96f4b0-6794-48f1-95f3-432895ebce03" path="/var/lib/kubelet/pods/8f96f4b0-6794-48f1-95f3-432895ebce03/volumes" Jul 20 04:45:16.907388 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:16.907347 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" event={"ID":"26140700-09b3-408f-8890-c7288274a145","Type":"ContainerStarted","Data":"df725b684772ac27ee5e138926531dd4f6e4ff2025a9738034b63c4357379445"} Jul 20 04:45:16.907826 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:16.907565 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:16.908793 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:16.908760 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerStarted","Data":"e303878238bb27bf20a244fd8ad8378ea409291e2893e0b9a09bdab6c67d0c47"} Jul 20 04:45:16.912803 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:16.912782 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" Jul 20 04:45:16.923561 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:16.923523 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np29v" podStartSLOduration=2.117256312 podStartE2EDuration="3.923507286s" totalImagesPullingTime="1.806250974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:45:16.921971899 +0000 UTC m=+318.753302005" watchObservedRunningTime="2026-07-20 04:45:16.923507286 +0000 UTC m=+318.754837391" Jul 20 04:45:17.915490 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:17.915454 2553 generic.go:356] "Generic (PLEG): container finished" podID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerID="3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0" exitCode=0 Jul 20 04:45:17.915926 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:17.915563 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerDied","Data":"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0"} Jul 20 04:45:21.934967 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:21.934929 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerStarted","Data":"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346"} Jul 20 04:45:21.935488 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:21.935014 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerStarted","Data":"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca"} Jul 20 04:45:23.945695 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:23.945662 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerStarted","Data":"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f"} Jul 20 04:45:23.946150 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:23.945751 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerStarted","Data":"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5"} Jul 20 04:45:23.946150 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:23.945775 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerStarted","Data":"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c"} Jul 20 04:45:23.946150 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:23.945805 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerStarted","Data":"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c"} Jul 20 04:45:23.972011 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:23.971958 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.107447073 podStartE2EDuration="8.971940597s" totalImagesPullingTime="5.844451116s" totalInitContainerRuntime="20.042408ms" isStatefulPod=false podCreationTimestamp="2026-07-20 04:45:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:45:23.970508439 +0000 UTC m=+325.801838545" watchObservedRunningTime="2026-07-20 04:45:23.971940597 +0000 UTC m=+325.803270705" Jul 20 04:45:25.491297 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:25.491262 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:45:30.972732 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:30.972695 2553 generic.go:356] "Generic (PLEG): container finished" podID="f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc" containerID="6b7bb09d9ba693e258a7b499de5c6c2d3e55559205d092e243fe0f791584eb85" exitCode=0 Jul 20 04:45:30.973134 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:30.972738 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jcd8d" event={"ID":"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc","Type":"ContainerDied","Data":"6b7bb09d9ba693e258a7b499de5c6c2d3e55559205d092e243fe0f791584eb85"} Jul 20 04:45:30.973134 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:30.973059 2553 scope.go:117] "RemoveContainer" containerID="6b7bb09d9ba693e258a7b499de5c6c2d3e55559205d092e243fe0f791584eb85" Jul 20 04:45:31.878574 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:31.878542 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84bb8_5265bc55-f1c7-4009-bd94-8e52da59a793/serve-healthcheck-canary/0.log" Jul 20 04:45:31.977798 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:45:31.977766 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jcd8d" event={"ID":"f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc","Type":"ContainerStarted","Data":"21ff013010cbf266256f9700db92b75ba024d0b96edff480d3baab1f7eb57305"} Jul 20 04:46:11.589746 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:11.589694 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:46:11.592179 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:11.592155 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3673a269-04f3-4369-9467-fea04e2ddf96-metrics-certs\") pod \"network-metrics-daemon-v84j5\" (UID: \"3673a269-04f3-4369-9467-fea04e2ddf96\") " pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:46:11.794165 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:11.794130 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-892m2\"" Jul 20 04:46:11.802112 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:11.802090 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v84j5" Jul 20 04:46:11.947728 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:11.947696 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v84j5"] Jul 20 04:46:11.950945 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:46:11.950920 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3673a269_04f3_4369_9467_fea04e2ddf96.slice/crio-c9d04d605c07fb72771ca2ad1bd1b62caa27d0ad7fe46e06cbfd765e15c2a471 WatchSource:0}: Error finding container c9d04d605c07fb72771ca2ad1bd1b62caa27d0ad7fe46e06cbfd765e15c2a471: Status 404 returned error can't find the container with id c9d04d605c07fb72771ca2ad1bd1b62caa27d0ad7fe46e06cbfd765e15c2a471 Jul 20 04:46:12.120818 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:12.120719 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v84j5" event={"ID":"3673a269-04f3-4369-9467-fea04e2ddf96","Type":"ContainerStarted","Data":"c9d04d605c07fb72771ca2ad1bd1b62caa27d0ad7fe46e06cbfd765e15c2a471"} Jul 20 04:46:13.125979 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:13.125942 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v84j5" event={"ID":"3673a269-04f3-4369-9467-fea04e2ddf96","Type":"ContainerStarted","Data":"11585f308e173253732e97a0d8924a3b7815616e822bfe4ab17d984f9f07d293"} Jul 20 04:46:13.126401 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:13.126005 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v84j5" event={"ID":"3673a269-04f3-4369-9467-fea04e2ddf96","Type":"ContainerStarted","Data":"4b145b106ae5c29d9bf6dc895473af9b3583caac3617c866b9dbc30e9353233b"} Jul 20 04:46:13.141231 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:13.141185 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v84j5" podStartSLOduration=373.362497779 podStartE2EDuration="6m14.141169708s" totalImagesPullingTime="778.671929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:46:13.140149766 +0000 UTC m=+374.971479872" watchObservedRunningTime="2026-07-20 04:46:13.141169708 +0000 UTC m=+374.972499812" Jul 20 04:46:15.491880 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:15.491849 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:15.511854 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:15.511829 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:16.153466 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:16.153434 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:33.484942 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.484905 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 04:46:33.485497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.485439 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="prometheus" containerID="cri-o://59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" gracePeriod=600 Jul 20 04:46:33.485846 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.485644 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="config-reloader" containerID="cri-o://db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" gracePeriod=600 Jul 20 04:46:33.485974 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.485877 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy-web" containerID="cri-o://ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" gracePeriod=600 Jul 20 04:46:33.485974 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.485923 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy" containerID="cri-o://5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" gracePeriod=600 Jul 20 04:46:33.485974 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.485961 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" gracePeriod=600 Jul 20 04:46:33.486912 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.486144 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="thanos-sidecar" containerID="cri-o://d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" gracePeriod=600 Jul 20 04:46:33.744174 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.744105 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:33.777142 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777108 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-grpc-tls\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.777331 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777161 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-kube-rbac-proxy\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777538 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-0\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777603 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-trusted-ca-bundle\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777632 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-metrics-client-certs\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777659 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-serving-certs-ca-bundle\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777711 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-web-config\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777737 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-kubelet-serving-ca-bundle\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777771 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-2\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777810 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6d2b\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-kube-api-access-b6d2b\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777837 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777888 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-db\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777915 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-tls-assets\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777947 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-thanos-prometheus-http-client-file\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.777984 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config-out\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.778009 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-1\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.778055 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-metrics-client-ca\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.778087 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-tls\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.778118 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.778685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.778141 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config\") pod \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\" (UID: \"73f3c0bb-52a0-49ba-915b-ed7c70af92fc\") " Jul 20 04:46:33.779666 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.778140 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:46:33.779666 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.778405 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.779666 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.778649 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:46:33.779666 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.778914 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:46:33.779666 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.779211 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 04:46:33.781529 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.780616 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:46:33.781529 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.781007 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:46:33.781529 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.781051 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:46:33.781529 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.781385 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:46:33.782177 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.782149 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:46:33.783899 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.783869 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:46:33.784492 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.784453 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:46:33.786720 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.785138 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:46:33.786720 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.785226 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:46:33.788804 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.788765 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:46:33.788892 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.788854 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config" (OuterVolumeSpecName: "config") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:46:33.789063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.789022 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config-out" (OuterVolumeSpecName: "config-out") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 04:46:33.789140 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.789115 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:46:33.789193 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.789140 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-kube-api-access-b6d2b" (OuterVolumeSpecName: "kube-api-access-b6d2b") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "kube-api-access-b6d2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 04:46:33.789355 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.789329 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 04:46:33.801198 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.801162 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-web-config" (OuterVolumeSpecName: "web-config") pod "73f3c0bb-52a0-49ba-915b-ed7c70af92fc" (UID: "73f3c0bb-52a0-49ba-915b-ed7c70af92fc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:46:33.879097 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879062 2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-tls-assets\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879097 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879091 2553 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879097 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879102 2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config-out\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879116 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879125 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-metrics-client-ca\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879142 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879151 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879160 2553 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879168 2553 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-grpc-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879178 2553 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-kube-rbac-proxy\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879185 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879193 2553 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-metrics-client-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879201 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879209 2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-web-config\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879216 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879224 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879232 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6d2b\" (UniqueName: \"kubernetes.io/projected/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-kube-api-access-b6d2b\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879240 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:33.879354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:33.879252 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73f3c0bb-52a0-49ba-915b-ed7c70af92fc-prometheus-k8s-db\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:46:34.205327 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205278 2553 generic.go:356] "Generic (PLEG): container finished" podID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerID="4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" exitCode=0 Jul 20 04:46:34.205327 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205303 2553 generic.go:356] "Generic (PLEG): container finished" podID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerID="5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" exitCode=0 Jul 20 04:46:34.205327 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205323 2553 generic.go:356] "Generic (PLEG): container finished" podID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerID="ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" exitCode=0 Jul 20 04:46:34.205327 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205329 2553 generic.go:356] "Generic (PLEG): container finished" podID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerID="d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" exitCode=0 Jul 20 04:46:34.205327 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205334 2553 generic.go:356] "Generic (PLEG): container finished" podID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerID="db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" exitCode=0 Jul 20 04:46:34.205327 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205339 2553 generic.go:356] "Generic (PLEG): container finished" podID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerID="59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" exitCode=0 Jul 20 04:46:34.205670 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205348 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerDied","Data":"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f"} Jul 20 04:46:34.205670 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205381 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.205670 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205450 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerDied","Data":"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5"} Jul 20 04:46:34.205670 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205478 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerDied","Data":"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c"} Jul 20 04:46:34.205670 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205503 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerDied","Data":"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c"} Jul 20 04:46:34.205670 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205515 2553 scope.go:117] "RemoveContainer" containerID="4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" Jul 20 04:46:34.205670 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205528 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerDied","Data":"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346"} Jul 20 04:46:34.205670 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205551 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerDied","Data":"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca"} Jul 20 04:46:34.205670 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.205578 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73f3c0bb-52a0-49ba-915b-ed7c70af92fc","Type":"ContainerDied","Data":"e303878238bb27bf20a244fd8ad8378ea409291e2893e0b9a09bdab6c67d0c47"} Jul 20 04:46:34.214111 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.214096 2553 scope.go:117] "RemoveContainer" containerID="5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" Jul 20 04:46:34.221806 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.221783 2553 scope.go:117] "RemoveContainer" containerID="ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" Jul 20 04:46:34.229715 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.229685 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 04:46:34.230231 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.230209 2553 scope.go:117] "RemoveContainer" containerID="d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" Jul 20 04:46:34.233039 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.233015 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 04:46:34.238257 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.238240 2553 scope.go:117] "RemoveContainer" containerID="db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" Jul 20 04:46:34.245715 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.245693 2553 scope.go:117] "RemoveContainer" containerID="59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" Jul 20 04:46:34.253252 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.253235 2553 scope.go:117] "RemoveContainer" containerID="3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0" Jul 20 04:46:34.255793 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.255773 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 04:46:34.256032 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256021 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="init-config-reloader" Jul 20 04:46:34.256075 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256034 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="init-config-reloader" Jul 20 04:46:34.256075 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256043 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy-web" Jul 20 04:46:34.256075 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256049 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy-web" Jul 20 04:46:34.256075 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256060 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="prometheus" Jul 20 04:46:34.256075 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256067 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="prometheus" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256077 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="config-reloader" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256082 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="config-reloader" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256087 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="thanos-sidecar" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256092 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="thanos-sidecar" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256101 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256107 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256113 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy-thanos" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256118 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy-thanos" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256156 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy-thanos" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256164 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy-web" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256170 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="config-reloader" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256175 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="prometheus" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256179 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="kube-rbac-proxy" Jul 20 04:46:34.256223 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.256186 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" containerName="thanos-sidecar" Jul 20 04:46:34.260646 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.260605 2553 scope.go:117] "RemoveContainer" containerID="4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" Jul 20 04:46:34.260965 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:46:34.260939 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": container with ID starting with 4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f not found: ID does not exist" containerID="4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" Jul 20 04:46:34.261064 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.260976 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f"} err="failed to get container status \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": rpc error: code = NotFound desc = could not find container \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": container with ID starting with 4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f not found: ID does not exist" Jul 20 04:46:34.261064 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.261028 2553 scope.go:117] "RemoveContainer" containerID="5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" Jul 20 04:46:34.261064 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.261050 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.263393 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:46:34.261365 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": container with ID starting with 5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5 not found: ID does not exist" containerID="5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" Jul 20 04:46:34.263393 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.261402 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5"} err="failed to get container status \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": rpc error: code = NotFound desc = could not find container \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": container with ID starting with 5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5 not found: ID does not exist" Jul 20 04:46:34.263393 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.261424 2553 scope.go:117] "RemoveContainer" containerID="ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" Jul 20 04:46:34.263393 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:46:34.262861 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": container with ID starting with ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c not found: ID does not exist" containerID="ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" Jul 20 04:46:34.263393 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.262890 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c"} err="failed to get container status \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": rpc error: code = NotFound desc = could not find container \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": container with ID starting with ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c not found: ID does not exist" Jul 20 04:46:34.263393 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.262911 2553 scope.go:117] "RemoveContainer" containerID="d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" Jul 20 04:46:34.263393 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:46:34.263165 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": container with ID starting with d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c not found: ID does not exist" containerID="d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" Jul 20 04:46:34.263393 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.263189 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c"} err="failed to get container status \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": rpc error: code = NotFound desc = could not find container \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": container with ID starting with d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c not found: ID does not exist" Jul 20 04:46:34.263393 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.263208 2553 scope.go:117] "RemoveContainer" containerID="db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" Jul 20 04:46:34.263863 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:46:34.263510 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": container with ID starting with db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346 not found: ID does not exist" containerID="db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" Jul 20 04:46:34.263863 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.263536 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346"} err="failed to get container status \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": rpc error: code = NotFound desc = could not find container \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": container with ID starting with db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346 not found: ID does not exist" Jul 20 04:46:34.263863 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.263557 2553 scope.go:117] "RemoveContainer" containerID="59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" Jul 20 04:46:34.263863 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.263760 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 04:46:34.263863 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.263784 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 04:46:34.264084 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.263891 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bivai0fbcsk52\"" Jul 20 04:46:34.264084 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:46:34.263908 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": container with ID starting with 59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca not found: ID does not exist" containerID="59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" Jul 20 04:46:34.264084 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.263932 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca"} err="failed to get container status \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": rpc error: code = NotFound desc = could not find container \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": container with ID starting with 59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca not found: ID does not exist" Jul 20 04:46:34.264084 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.263950 2553 scope.go:117] "RemoveContainer" containerID="3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0" Jul 20 04:46:34.264460 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264267 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 04:46:34.264460 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:46:34.264366 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": container with ID starting with 3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0 not found: ID does not exist" containerID="3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0" Jul 20 04:46:34.264460 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264403 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 04:46:34.264460 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264395 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 04:46:34.264460 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264399 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0"} err="failed to get container status \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": rpc error: code = NotFound desc = could not find container \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": container with ID starting with 3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0 not found: ID does not exist" Jul 20 04:46:34.264460 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264449 2553 scope.go:117] "RemoveContainer" containerID="4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" Jul 20 04:46:34.264830 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264676 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 04:46:34.264830 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264696 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 04:46:34.264830 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264754 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 04:46:34.264975 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264846 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f"} err="failed to get container status \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": rpc error: code = NotFound desc = could not find container \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": container with ID starting with 4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f not found: ID does not exist" Jul 20 04:46:34.264975 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264882 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 04:46:34.264975 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.264869 2553 scope.go:117] "RemoveContainer" containerID="5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" Jul 20 04:46:34.265133 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265114 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5px2d\"" Jul 20 04:46:34.265226 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265190 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5"} err="failed to get container status \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": rpc error: code = NotFound desc = could not find container \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": container with ID starting with 5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5 not found: ID does not exist" Jul 20 04:46:34.265226 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265216 2553 scope.go:117] "RemoveContainer" containerID="ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" Jul 20 04:46:34.265475 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265232 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 04:46:34.265475 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265367 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 04:46:34.265475 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265401 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 04:46:34.265629 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265489 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c"} err="failed to get container status \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": rpc error: code = NotFound desc = could not find container \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": container with ID starting with ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c not found: ID does not exist" Jul 20 04:46:34.265629 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265508 2553 scope.go:117] "RemoveContainer" containerID="d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" Jul 20 04:46:34.265629 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265525 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 04:46:34.265877 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265848 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c"} err="failed to get container status \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": rpc error: code = NotFound desc = could not find container \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": container with ID starting with d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c not found: ID does not exist" Jul 20 04:46:34.265877 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.265877 2553 scope.go:117] "RemoveContainer" containerID="db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" Jul 20 04:46:34.266230 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.266205 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346"} err="failed to get container status \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": rpc error: code = NotFound desc = could not find container \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": container with ID starting with db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346 not found: ID does not exist" Jul 20 04:46:34.266230 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.266232 2553 scope.go:117] "RemoveContainer" containerID="59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" Jul 20 04:46:34.266540 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.266515 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca"} err="failed to get container status \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": rpc error: code = NotFound desc = could not find container \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": container with ID starting with 59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca not found: ID does not exist" Jul 20 04:46:34.266540 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.266539 2553 scope.go:117] "RemoveContainer" containerID="3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0" Jul 20 04:46:34.266802 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.266779 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0"} err="failed to get container status \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": rpc error: code = NotFound desc = could not find container \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": container with ID starting with 3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0 not found: ID does not exist" Jul 20 04:46:34.266908 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.266803 2553 scope.go:117] "RemoveContainer" containerID="4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" Jul 20 04:46:34.267092 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.267068 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f"} err="failed to get container status \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": rpc error: code = NotFound desc = could not find container \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": container with ID starting with 4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f not found: ID does not exist" Jul 20 04:46:34.267166 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.267096 2553 scope.go:117] "RemoveContainer" containerID="5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" Jul 20 04:46:34.267404 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.267381 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5"} err="failed to get container status \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": rpc error: code = NotFound desc = could not find container \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": container with ID starting with 5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5 not found: ID does not exist" Jul 20 04:46:34.267477 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.267408 2553 scope.go:117] "RemoveContainer" containerID="ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" Jul 20 04:46:34.267477 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.267416 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 04:46:34.267684 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.267662 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c"} err="failed to get container status \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": rpc error: code = NotFound desc = could not find container \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": container with ID starting with ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c not found: ID does not exist" Jul 20 04:46:34.267750 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.267686 2553 scope.go:117] "RemoveContainer" containerID="d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" Jul 20 04:46:34.267972 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.267952 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c"} err="failed to get container status \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": rpc error: code = NotFound desc = could not find container \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": container with ID starting with d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c not found: ID does not exist" Jul 20 04:46:34.268044 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.267974 2553 scope.go:117] "RemoveContainer" containerID="db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" Jul 20 04:46:34.268259 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.268242 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346"} err="failed to get container status \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": rpc error: code = NotFound desc = could not find container \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": container with ID starting with db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346 not found: ID does not exist" Jul 20 04:46:34.268360 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.268261 2553 scope.go:117] "RemoveContainer" containerID="59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" Jul 20 04:46:34.268590 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.268548 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca"} err="failed to get container status \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": rpc error: code = NotFound desc = could not find container \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": container with ID starting with 59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca not found: ID does not exist" Jul 20 04:46:34.268637 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.268592 2553 scope.go:117] "RemoveContainer" containerID="3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0" Jul 20 04:46:34.268868 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.268850 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0"} err="failed to get container status \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": rpc error: code = NotFound desc = could not find container \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": container with ID starting with 3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0 not found: ID does not exist" Jul 20 04:46:34.268939 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.268870 2553 scope.go:117] "RemoveContainer" containerID="4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" Jul 20 04:46:34.269112 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.269090 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f"} err="failed to get container status \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": rpc error: code = NotFound desc = could not find container \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": container with ID starting with 4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f not found: ID does not exist" Jul 20 04:46:34.269166 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.269115 2553 scope.go:117] "RemoveContainer" containerID="5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" Jul 20 04:46:34.269395 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.269374 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5"} err="failed to get container status \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": rpc error: code = NotFound desc = could not find container \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": container with ID starting with 5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5 not found: ID does not exist" Jul 20 04:46:34.269522 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.269507 2553 scope.go:117] "RemoveContainer" containerID="ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" Jul 20 04:46:34.269893 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.269870 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c"} err="failed to get container status \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": rpc error: code = NotFound desc = could not find container \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": container with ID starting with ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c not found: ID does not exist" Jul 20 04:46:34.270004 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.269895 2553 scope.go:117] "RemoveContainer" containerID="d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" Jul 20 04:46:34.270004 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.269919 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 04:46:34.270176 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.270155 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c"} err="failed to get container status \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": rpc error: code = NotFound desc = could not find container \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": container with ID starting with d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c not found: ID does not exist" Jul 20 04:46:34.270176 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.270178 2553 scope.go:117] "RemoveContainer" containerID="db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" Jul 20 04:46:34.270513 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.270493 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346"} err="failed to get container status \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": rpc error: code = NotFound desc = could not find container \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": container with ID starting with db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346 not found: ID does not exist" Jul 20 04:46:34.270580 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.270514 2553 scope.go:117] "RemoveContainer" containerID="59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" Jul 20 04:46:34.270771 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.270750 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca"} err="failed to get container status \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": rpc error: code = NotFound desc = could not find container \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": container with ID starting with 59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca not found: ID does not exist" Jul 20 04:46:34.270850 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.270772 2553 scope.go:117] "RemoveContainer" containerID="3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0" Jul 20 04:46:34.271027 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.271006 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0"} err="failed to get container status \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": rpc error: code = NotFound desc = could not find container \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": container with ID starting with 3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0 not found: ID does not exist" Jul 20 04:46:34.271096 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.271029 2553 scope.go:117] "RemoveContainer" containerID="4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" Jul 20 04:46:34.271406 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.271376 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f"} err="failed to get container status \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": rpc error: code = NotFound desc = could not find container \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": container with ID starting with 4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f not found: ID does not exist" Jul 20 04:46:34.271496 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.271407 2553 scope.go:117] "RemoveContainer" containerID="5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" Jul 20 04:46:34.271785 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.271733 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5"} err="failed to get container status \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": rpc error: code = NotFound desc = could not find container \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": container with ID starting with 5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5 not found: ID does not exist" Jul 20 04:46:34.271922 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.271787 2553 scope.go:117] "RemoveContainer" containerID="ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" Jul 20 04:46:34.272240 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.272135 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c"} err="failed to get container status \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": rpc error: code = NotFound desc = could not find container \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": container with ID starting with ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c not found: ID does not exist" Jul 20 04:46:34.272240 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.272162 2553 scope.go:117] "RemoveContainer" containerID="d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" Jul 20 04:46:34.272665 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.272640 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c"} err="failed to get container status \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": rpc error: code = NotFound desc = could not find container \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": container with ID starting with d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c not found: ID does not exist" Jul 20 04:46:34.272665 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.272666 2553 scope.go:117] "RemoveContainer" containerID="db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" Jul 20 04:46:34.272951 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.272926 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346"} err="failed to get container status \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": rpc error: code = NotFound desc = could not find container \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": container with ID starting with db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346 not found: ID does not exist" Jul 20 04:46:34.272951 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.272949 2553 scope.go:117] "RemoveContainer" containerID="59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" Jul 20 04:46:34.273221 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.273198 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca"} err="failed to get container status \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": rpc error: code = NotFound desc = could not find container \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": container with ID starting with 59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca not found: ID does not exist" Jul 20 04:46:34.273302 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.273223 2553 scope.go:117] "RemoveContainer" containerID="3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0" Jul 20 04:46:34.273554 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.273514 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0"} err="failed to get container status \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": rpc error: code = NotFound desc = could not find container \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": container with ID starting with 3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0 not found: ID does not exist" Jul 20 04:46:34.273671 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.273555 2553 scope.go:117] "RemoveContainer" containerID="4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f" Jul 20 04:46:34.273878 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.273829 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f"} err="failed to get container status \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": rpc error: code = NotFound desc = could not find container \"4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f\": container with ID starting with 4b87f8a36788df598167f916886072bf891957a5f6a2a4220cc20dd75284c09f not found: ID does not exist" Jul 20 04:46:34.273878 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.273867 2553 scope.go:117] "RemoveContainer" containerID="5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5" Jul 20 04:46:34.274010 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.273852 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 04:46:34.274183 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.274163 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5"} err="failed to get container status \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": rpc error: code = NotFound desc = could not find container \"5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5\": container with ID starting with 5774a2af9d33a93c64d203373bba44fc10446e36706839bba63a5ba2111ce1c5 not found: ID does not exist" Jul 20 04:46:34.274183 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.274183 2553 scope.go:117] "RemoveContainer" containerID="ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c" Jul 20 04:46:34.274485 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.274459 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c"} err="failed to get container status \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": rpc error: code = NotFound desc = could not find container \"ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c\": container with ID starting with ef1f9129e72ab0179b6f1397925b448d78966627d243c1d23018c04009535b6c not found: ID does not exist" Jul 20 04:46:34.274547 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.274487 2553 scope.go:117] "RemoveContainer" containerID="d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c" Jul 20 04:46:34.274731 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.274703 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c"} err="failed to get container status \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": rpc error: code = NotFound desc = could not find container \"d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c\": container with ID starting with d2b49cce998ca4e0f1cfd091147458a1bbf6a401895e405e236acef25328c24c not found: ID does not exist" Jul 20 04:46:34.274803 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.274734 2553 scope.go:117] "RemoveContainer" containerID="db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346" Jul 20 04:46:34.274995 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.274979 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346"} err="failed to get container status \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": rpc error: code = NotFound desc = could not find container \"db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346\": container with ID starting with db57946857a8d6558139ce9a584231119db1f90bbf217bd0941c84a2537c8346 not found: ID does not exist" Jul 20 04:46:34.275061 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.274996 2553 scope.go:117] "RemoveContainer" containerID="59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca" Jul 20 04:46:34.275210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.275193 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca"} err="failed to get container status \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": rpc error: code = NotFound desc = could not find container \"59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca\": container with ID starting with 59e92ba24a3ec6b279b2b0e0041b069e65a4c56b3374f5e1687cc2dbc4a131ca not found: ID does not exist" Jul 20 04:46:34.275260 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.275212 2553 scope.go:117] "RemoveContainer" containerID="3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0" Jul 20 04:46:34.275434 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.275418 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0"} err="failed to get container status \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": rpc error: code = NotFound desc = could not find container \"3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0\": container with ID starting with 3dc5488ec8a51a3aa8280f87c3b01139211ba7960c3d7f008837f6ef799ebda0 not found: ID does not exist" Jul 20 04:46:34.383980 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.383939 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.383980 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.383980 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cb5bfdf-0269-433c-9c23-33462eb27ed8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384006 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384091 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384140 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384165 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384192 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384243 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384231 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384257 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384285 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-web-config\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384343 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384371 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384410 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384453 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384482 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm2p2\" (UniqueName: \"kubernetes.io/projected/7cb5bfdf-0269-433c-9c23-33462eb27ed8-kube-api-access-tm2p2\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384502 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-config\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384518 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384533 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cb5bfdf-0269-433c-9c23-33462eb27ed8-config-out\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384861 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384562 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.384861 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.384585 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.486048 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.485950 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.486048 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486001 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.486048 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.486652 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486054 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-web-config\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.486652 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.486652 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486097 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.486652 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486126 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.487071 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486662 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.487071 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486705 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm2p2\" (UniqueName: \"kubernetes.io/projected/7cb5bfdf-0269-433c-9c23-33462eb27ed8-kube-api-access-tm2p2\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.487071 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486736 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.487071 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486827 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.486742 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-config\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487379 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487412 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cb5bfdf-0269-433c-9c23-33462eb27ed8-config-out\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487461 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487501 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487536 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487541 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487564 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cb5bfdf-0269-433c-9c23-33462eb27ed8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487593 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487621 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487664 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.487692 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.488578 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.488246 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.489217 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.488696 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.489349 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.489323 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.489422 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.489369 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.489422 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.489383 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-web-config\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.489971 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.489630 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-config\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.489971 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.489646 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.490493 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.490168 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.490687 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.490611 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7cb5bfdf-0269-433c-9c23-33462eb27ed8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.491030 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.490981 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.491201 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.491178 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cb5bfdf-0269-433c-9c23-33462eb27ed8-config-out\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.491388 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.491371 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.491969 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.491942 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.492102 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.492083 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.492203 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.492185 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cb5bfdf-0269-433c-9c23-33462eb27ed8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.492616 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.492594 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7cb5bfdf-0269-433c-9c23-33462eb27ed8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.495154 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.495137 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm2p2\" (UniqueName: \"kubernetes.io/projected/7cb5bfdf-0269-433c-9c23-33462eb27ed8-kube-api-access-tm2p2\") pod \"prometheus-k8s-0\" (UID: \"7cb5bfdf-0269-433c-9c23-33462eb27ed8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.575635 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.575594 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:46:34.697142 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.697110 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73f3c0bb-52a0-49ba-915b-ed7c70af92fc" path="/var/lib/kubelet/pods/73f3c0bb-52a0-49ba-915b-ed7c70af92fc/volumes" Jul 20 04:46:34.715917 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:34.715897 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 04:46:34.718299 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:46:34.718276 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb5bfdf_0269_433c_9c23_33462eb27ed8.slice/crio-76f286785c9883dff960d0007d979b5974c5ea2c04d854e62b6da262b08597e1 WatchSource:0}: Error finding container 76f286785c9883dff960d0007d979b5974c5ea2c04d854e62b6da262b08597e1: Status 404 returned error can't find the container with id 76f286785c9883dff960d0007d979b5974c5ea2c04d854e62b6da262b08597e1 Jul 20 04:46:35.211057 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:35.211019 2553 generic.go:356] "Generic (PLEG): container finished" podID="7cb5bfdf-0269-433c-9c23-33462eb27ed8" containerID="6c180055996f3c77b55f7e206609897611ec82645087c191d4ae21ce6aa0a3f5" exitCode=0 Jul 20 04:46:35.211213 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:35.211079 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb5bfdf-0269-433c-9c23-33462eb27ed8","Type":"ContainerDied","Data":"6c180055996f3c77b55f7e206609897611ec82645087c191d4ae21ce6aa0a3f5"} Jul 20 04:46:35.211213 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:35.211131 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb5bfdf-0269-433c-9c23-33462eb27ed8","Type":"ContainerStarted","Data":"76f286785c9883dff960d0007d979b5974c5ea2c04d854e62b6da262b08597e1"} Jul 20 04:46:36.218052 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:36.218013 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb5bfdf-0269-433c-9c23-33462eb27ed8","Type":"ContainerStarted","Data":"813b89f3ff5c05bdcd5dbb0c0c6ed8a2fb3523b293f484d54159fabb4967004e"} Jul 20 04:46:36.218445 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:36.218078 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb5bfdf-0269-433c-9c23-33462eb27ed8","Type":"ContainerStarted","Data":"5c5ee45dd6f275aaac2b659ac839110cc6a3d28ca3cf62f5fcb2db210f19f1c2"} Jul 20 04:46:36.218445 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:36.218106 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb5bfdf-0269-433c-9c23-33462eb27ed8","Type":"ContainerStarted","Data":"1a26aab10ecbb5a05a6f5d1eb4c8398be46f2be3d5bc26c9524ff4c68215f424"} Jul 20 04:46:36.218445 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:36.218147 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb5bfdf-0269-433c-9c23-33462eb27ed8","Type":"ContainerStarted","Data":"eec1da416ccc8d9e9c5efdb503529f1aace70d8dd14f90a798432c7eae893279"} Jul 20 04:46:36.218445 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:36.218170 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb5bfdf-0269-433c-9c23-33462eb27ed8","Type":"ContainerStarted","Data":"5afc3f1ea596636a6ed7aa1b47fc6fb32e215b6ceb4eec878e2af36c488d9213"} Jul 20 04:46:36.218445 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:36.218192 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7cb5bfdf-0269-433c-9c23-33462eb27ed8","Type":"ContainerStarted","Data":"7f427fbd30a788c51609e53bfada8946f0492249d2fa8f2d65d93bb9a871b8a1"} Jul 20 04:46:36.245090 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:36.245028 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.225387001 podStartE2EDuration="2.245006388s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.619387ms" isStatefulPod=false podCreationTimestamp="2026-07-20 04:46:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:46:36.242911001 +0000 UTC m=+398.074241110" watchObservedRunningTime="2026-07-20 04:46:36.245006388 +0000 UTC m=+398.076336494" Jul 20 04:46:39.576415 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:46:39.576378 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:47:34.576741 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:47:34.576684 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:47:34.593502 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:47:34.593476 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:47:35.457896 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:47:35.457870 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 04:48:23.081815 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.081779 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld"] Jul 20 04:48:23.084883 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.084865 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" Jul 20 04:48:23.087420 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.087394 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 04:48:23.087420 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.087406 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hhl99\"" Jul 20 04:48:23.088197 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.088183 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 04:48:23.091903 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.091881 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld"] Jul 20 04:48:23.226834 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.226794 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59b1104d-f5b1-4d27-acfb-4c9877bb4f51-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cplld\" (UID: \"59b1104d-f5b1-4d27-acfb-4c9877bb4f51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" Jul 20 04:48:23.226834 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.226836 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvbnf\" (UniqueName: \"kubernetes.io/projected/59b1104d-f5b1-4d27-acfb-4c9877bb4f51-kube-api-access-hvbnf\") pod \"openshift-lws-operator-fd8ccff4c-cplld\" (UID: \"59b1104d-f5b1-4d27-acfb-4c9877bb4f51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" Jul 20 04:48:23.328117 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.328075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvbnf\" (UniqueName: \"kubernetes.io/projected/59b1104d-f5b1-4d27-acfb-4c9877bb4f51-kube-api-access-hvbnf\") pod \"openshift-lws-operator-fd8ccff4c-cplld\" (UID: \"59b1104d-f5b1-4d27-acfb-4c9877bb4f51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" Jul 20 04:48:23.328336 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.328204 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59b1104d-f5b1-4d27-acfb-4c9877bb4f51-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cplld\" (UID: \"59b1104d-f5b1-4d27-acfb-4c9877bb4f51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" Jul 20 04:48:23.328606 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.328583 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59b1104d-f5b1-4d27-acfb-4c9877bb4f51-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cplld\" (UID: \"59b1104d-f5b1-4d27-acfb-4c9877bb4f51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" Jul 20 04:48:23.336221 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.336173 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvbnf\" (UniqueName: \"kubernetes.io/projected/59b1104d-f5b1-4d27-acfb-4c9877bb4f51-kube-api-access-hvbnf\") pod \"openshift-lws-operator-fd8ccff4c-cplld\" (UID: \"59b1104d-f5b1-4d27-acfb-4c9877bb4f51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" Jul 20 04:48:23.404210 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.404179 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" Jul 20 04:48:23.533137 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.533103 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld"] Jul 20 04:48:23.536016 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:48:23.535987 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59b1104d_f5b1_4d27_acfb_4c9877bb4f51.slice/crio-2ba0d3507b25cd7b1bd56ada88250efa60142699cc68b922f680c8ec9fb8ea4b WatchSource:0}: Error finding container 2ba0d3507b25cd7b1bd56ada88250efa60142699cc68b922f680c8ec9fb8ea4b: Status 404 returned error can't find the container with id 2ba0d3507b25cd7b1bd56ada88250efa60142699cc68b922f680c8ec9fb8ea4b Jul 20 04:48:23.618271 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:23.618236 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" event={"ID":"59b1104d-f5b1-4d27-acfb-4c9877bb4f51","Type":"ContainerStarted","Data":"2ba0d3507b25cd7b1bd56ada88250efa60142699cc68b922f680c8ec9fb8ea4b"} Jul 20 04:48:40.684296 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:40.684260 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" event={"ID":"59b1104d-f5b1-4d27-acfb-4c9877bb4f51","Type":"ContainerStarted","Data":"bc9a5adbbf14f4cbbf092fb6811261dd2a23f26729f22213c5832c19033cf541"} Jul 20 04:48:40.700293 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:48:40.700243 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cplld" podStartSLOduration=1.408193452 podStartE2EDuration="17.700227199s" totalImagesPullingTime="16.292033747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:48:40.698202412 +0000 UTC m=+522.529532516" watchObservedRunningTime="2026-07-20 04:48:40.700227199 +0000 UTC m=+522.531557385" Jul 20 04:49:00.176414 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.176376 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc"] Jul 20 04:49:00.183063 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.183042 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.185273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.185252 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 04:49:00.185421 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.185390 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lhfv4\"" Jul 20 04:49:00.185557 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.185542 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 04:49:00.185719 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.185700 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 04:49:00.185803 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.185787 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 04:49:00.194197 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.194170 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc"] Jul 20 04:49:00.238613 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.238578 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7539339c-7389-44f0-8214-09aaffa0f607-tmp\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.238781 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.238637 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7539339c-7389-44f0-8214-09aaffa0f607-manifests\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.238781 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.238703 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7539339c-7389-44f0-8214-09aaffa0f607-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.238781 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.238730 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7539339c-7389-44f0-8214-09aaffa0f607-webhook-cert\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.238781 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.238760 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49rd\" (UniqueName: \"kubernetes.io/projected/7539339c-7389-44f0-8214-09aaffa0f607-kube-api-access-k49rd\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.339906 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.339871 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7539339c-7389-44f0-8214-09aaffa0f607-manifests\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.340106 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.339914 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7539339c-7389-44f0-8214-09aaffa0f607-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.340106 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.339939 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7539339c-7389-44f0-8214-09aaffa0f607-webhook-cert\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.340280 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.340127 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49rd\" (UniqueName: \"kubernetes.io/projected/7539339c-7389-44f0-8214-09aaffa0f607-kube-api-access-k49rd\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.340280 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.340227 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7539339c-7389-44f0-8214-09aaffa0f607-tmp\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.340420 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.340352 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7539339c-7389-44f0-8214-09aaffa0f607-manifests\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.342481 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.342452 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7539339c-7389-44f0-8214-09aaffa0f607-tmp\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.342600 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.342583 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7539339c-7389-44f0-8214-09aaffa0f607-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.342742 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.342724 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7539339c-7389-44f0-8214-09aaffa0f607-webhook-cert\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.348016 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.347993 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49rd\" (UniqueName: \"kubernetes.io/projected/7539339c-7389-44f0-8214-09aaffa0f607-kube-api-access-k49rd\") pod \"opendatahub-operator-controller-manager-bbbb7cf9b-khmxc\" (UID: \"7539339c-7389-44f0-8214-09aaffa0f607\") " pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.494859 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.494773 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:00.636120 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.636081 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc"] Jul 20 04:49:00.639666 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:49:00.639638 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7539339c_7389_44f0_8214_09aaffa0f607.slice/crio-272bdd948100a755c5c6ce1434bf06ca722016edc6ee5db4d9b951da88ebf103 WatchSource:0}: Error finding container 272bdd948100a755c5c6ce1434bf06ca722016edc6ee5db4d9b951da88ebf103: Status 404 returned error can't find the container with id 272bdd948100a755c5c6ce1434bf06ca722016edc6ee5db4d9b951da88ebf103 Jul 20 04:49:00.758566 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:00.758482 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" event={"ID":"7539339c-7389-44f0-8214-09aaffa0f607","Type":"ContainerStarted","Data":"272bdd948100a755c5c6ce1434bf06ca722016edc6ee5db4d9b951da88ebf103"} Jul 20 04:49:03.776510 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:03.776475 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" event={"ID":"7539339c-7389-44f0-8214-09aaffa0f607","Type":"ContainerStarted","Data":"8a92749fbb5dd6a0b584f728a4dcf6e9b9a8fb56b8ec74b2a16192fd979901ec"} Jul 20 04:49:05.786355 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:05.786296 2553 generic.go:356] "Generic (PLEG): container finished" podID="7539339c-7389-44f0-8214-09aaffa0f607" containerID="8a92749fbb5dd6a0b584f728a4dcf6e9b9a8fb56b8ec74b2a16192fd979901ec" exitCode=0 Jul 20 04:49:05.786931 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:05.786371 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" event={"ID":"7539339c-7389-44f0-8214-09aaffa0f607","Type":"ContainerDied","Data":"8a92749fbb5dd6a0b584f728a4dcf6e9b9a8fb56b8ec74b2a16192fd979901ec"} Jul 20 04:49:06.792159 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:06.792123 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" event={"ID":"7539339c-7389-44f0-8214-09aaffa0f607","Type":"ContainerStarted","Data":"fc38fb78b0cb07ed0b50f0a1ea4876a47d05991e5b73472265c200476f677c2d"} Jul 20 04:49:06.792547 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:06.792350 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:06.813323 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:06.813265 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" podStartSLOduration=2.421779185 podStartE2EDuration="6.813248544s" totalImagesPullingTime="3.294036131s" totalInitContainerRuntime="1.097433228s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:49:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:49:06.812404295 +0000 UTC m=+548.643734411" watchObservedRunningTime="2026-07-20 04:49:06.813248544 +0000 UTC m=+548.644578648" Jul 20 04:49:17.798211 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:17.798176 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bbbb7cf9b-khmxc" Jul 20 04:49:19.640536 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.640499 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng"] Jul 20 04:49:19.648817 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.648792 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.651530 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.651503 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 20 04:49:19.651530 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.651520 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 04:49:19.651714 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.651565 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 20 04:49:19.651714 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.651627 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 04:49:19.652416 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.652397 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p5fcl\"" Jul 20 04:49:19.657763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.657739 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng"] Jul 20 04:49:19.819233 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.819205 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65f36e02-96f6-43d5-b325-423a1e061a13-tmp\") pod \"kube-auth-proxy-6ff6d67bdf-cpcng\" (UID: \"65f36e02-96f6-43d5-b325-423a1e061a13\") " pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.819429 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.819253 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65f36e02-96f6-43d5-b325-423a1e061a13-tls-certs\") pod \"kube-auth-proxy-6ff6d67bdf-cpcng\" (UID: \"65f36e02-96f6-43d5-b325-423a1e061a13\") " pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.819429 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.819358 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smlb6\" (UniqueName: \"kubernetes.io/projected/65f36e02-96f6-43d5-b325-423a1e061a13-kube-api-access-smlb6\") pod \"kube-auth-proxy-6ff6d67bdf-cpcng\" (UID: \"65f36e02-96f6-43d5-b325-423a1e061a13\") " pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.920099 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.920008 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smlb6\" (UniqueName: \"kubernetes.io/projected/65f36e02-96f6-43d5-b325-423a1e061a13-kube-api-access-smlb6\") pod \"kube-auth-proxy-6ff6d67bdf-cpcng\" (UID: \"65f36e02-96f6-43d5-b325-423a1e061a13\") " pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.920099 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.920065 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65f36e02-96f6-43d5-b325-423a1e061a13-tmp\") pod \"kube-auth-proxy-6ff6d67bdf-cpcng\" (UID: \"65f36e02-96f6-43d5-b325-423a1e061a13\") " pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.920373 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.920129 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65f36e02-96f6-43d5-b325-423a1e061a13-tls-certs\") pod \"kube-auth-proxy-6ff6d67bdf-cpcng\" (UID: \"65f36e02-96f6-43d5-b325-423a1e061a13\") " pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.922680 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.922645 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65f36e02-96f6-43d5-b325-423a1e061a13-tmp\") pod \"kube-auth-proxy-6ff6d67bdf-cpcng\" (UID: \"65f36e02-96f6-43d5-b325-423a1e061a13\") " pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.922861 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.922842 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65f36e02-96f6-43d5-b325-423a1e061a13-tls-certs\") pod \"kube-auth-proxy-6ff6d67bdf-cpcng\" (UID: \"65f36e02-96f6-43d5-b325-423a1e061a13\") " pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.935576 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.935548 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-snqz5"] Jul 20 04:49:19.937142 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.937107 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smlb6\" (UniqueName: \"kubernetes.io/projected/65f36e02-96f6-43d5-b325-423a1e061a13-kube-api-access-smlb6\") pod \"kube-auth-proxy-6ff6d67bdf-cpcng\" (UID: \"65f36e02-96f6-43d5-b325-423a1e061a13\") " pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:19.938888 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.938872 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:19.943079 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.943061 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 20 04:49:19.943215 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.943123 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2zfnf\"" Jul 20 04:49:19.950725 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.950382 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-snqz5"] Jul 20 04:49:19.959739 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:19.959716 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" Jul 20 04:49:20.021031 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.020986 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e21346e-fdef-4a5a-9e57-7c33900983d3-cert\") pod \"odh-model-controller-7998c67dc4-snqz5\" (UID: \"6e21346e-fdef-4a5a-9e57-7c33900983d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:20.021160 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.021058 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv9k4\" (UniqueName: \"kubernetes.io/projected/6e21346e-fdef-4a5a-9e57-7c33900983d3-kube-api-access-wv9k4\") pod \"odh-model-controller-7998c67dc4-snqz5\" (UID: \"6e21346e-fdef-4a5a-9e57-7c33900983d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:20.100586 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.100403 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng"] Jul 20 04:49:20.103129 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:49:20.103105 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f36e02_96f6_43d5_b325_423a1e061a13.slice/crio-1b4868bbb48bd5e65e9e6e3b970348a63dd3f9991d63249bc9b3810816ea52fc WatchSource:0}: Error finding container 1b4868bbb48bd5e65e9e6e3b970348a63dd3f9991d63249bc9b3810816ea52fc: Status 404 returned error can't find the container with id 1b4868bbb48bd5e65e9e6e3b970348a63dd3f9991d63249bc9b3810816ea52fc Jul 20 04:49:20.121616 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.121584 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e21346e-fdef-4a5a-9e57-7c33900983d3-cert\") pod \"odh-model-controller-7998c67dc4-snqz5\" (UID: \"6e21346e-fdef-4a5a-9e57-7c33900983d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:20.121768 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.121646 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv9k4\" (UniqueName: \"kubernetes.io/projected/6e21346e-fdef-4a5a-9e57-7c33900983d3-kube-api-access-wv9k4\") pod \"odh-model-controller-7998c67dc4-snqz5\" (UID: \"6e21346e-fdef-4a5a-9e57-7c33900983d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:20.121820 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:49:20.121782 2553 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 20 04:49:20.121857 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:49:20.121845 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e21346e-fdef-4a5a-9e57-7c33900983d3-cert podName:6e21346e-fdef-4a5a-9e57-7c33900983d3 nodeName:}" failed. No retries permitted until 2026-07-20 04:49:20.621825646 +0000 UTC m=+562.453155735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6e21346e-fdef-4a5a-9e57-7c33900983d3-cert") pod "odh-model-controller-7998c67dc4-snqz5" (UID: "6e21346e-fdef-4a5a-9e57-7c33900983d3") : secret "odh-model-controller-webhook-cert" not found Jul 20 04:49:20.132096 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.132066 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv9k4\" (UniqueName: \"kubernetes.io/projected/6e21346e-fdef-4a5a-9e57-7c33900983d3-kube-api-access-wv9k4\") pod \"odh-model-controller-7998c67dc4-snqz5\" (UID: \"6e21346e-fdef-4a5a-9e57-7c33900983d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:20.626273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.626238 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e21346e-fdef-4a5a-9e57-7c33900983d3-cert\") pod \"odh-model-controller-7998c67dc4-snqz5\" (UID: \"6e21346e-fdef-4a5a-9e57-7c33900983d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:20.629054 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.629022 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e21346e-fdef-4a5a-9e57-7c33900983d3-cert\") pod \"odh-model-controller-7998c67dc4-snqz5\" (UID: \"6e21346e-fdef-4a5a-9e57-7c33900983d3\") " pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:20.752512 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.752481 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jkwmq"] Jul 20 04:49:20.755992 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.755964 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:20.760279 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.760255 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 20 04:49:20.760433 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.760257 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-phgwq\"" Jul 20 04:49:20.771182 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.771136 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jkwmq"] Jul 20 04:49:20.856366 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.856331 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:20.857669 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.857636 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" event={"ID":"65f36e02-96f6-43d5-b325-423a1e061a13","Type":"ContainerStarted","Data":"1b4868bbb48bd5e65e9e6e3b970348a63dd3f9991d63249bc9b3810816ea52fc"} Jul 20 04:49:20.932530 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.932500 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktzqs\" (UniqueName: \"kubernetes.io/projected/0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd-kube-api-access-ktzqs\") pod \"model-serving-api-54d89bd5fc-jkwmq\" (UID: \"0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:20.932713 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.932558 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd-tls-certs\") pod \"model-serving-api-54d89bd5fc-jkwmq\" (UID: \"0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:20.996094 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:20.996062 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg"] Jul 20 04:49:21.000745 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.000719 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.003548 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.003379 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 04:49:21.003548 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.003397 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 04:49:21.003548 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.003379 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 04:49:21.003548 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.003533 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wlg8x\"" Jul 20 04:49:21.003855 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.003663 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 04:49:21.012598 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.012243 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg"] Jul 20 04:49:21.015363 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.015337 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-snqz5"] Jul 20 04:49:21.019665 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:49:21.019642 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e21346e_fdef_4a5a_9e57_7c33900983d3.slice/crio-ac936c25ce46c9a67acfb9182a05ae86b693cc3970be5895fdf2ab51ab078241 WatchSource:0}: Error finding container ac936c25ce46c9a67acfb9182a05ae86b693cc3970be5895fdf2ab51ab078241: Status 404 returned error can't find the container with id ac936c25ce46c9a67acfb9182a05ae86b693cc3970be5895fdf2ab51ab078241 Jul 20 04:49:21.034065 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.034029 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktzqs\" (UniqueName: \"kubernetes.io/projected/0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd-kube-api-access-ktzqs\") pod \"model-serving-api-54d89bd5fc-jkwmq\" (UID: \"0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:21.034346 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.034091 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd-tls-certs\") pod \"model-serving-api-54d89bd5fc-jkwmq\" (UID: \"0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:21.037355 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.037270 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd-tls-certs\") pod \"model-serving-api-54d89bd5fc-jkwmq\" (UID: \"0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:21.044373 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.044344 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktzqs\" (UniqueName: \"kubernetes.io/projected/0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd-kube-api-access-ktzqs\") pod \"model-serving-api-54d89bd5fc-jkwmq\" (UID: \"0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:21.071358 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.071289 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:21.136760 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.135477 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.136760 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.135550 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-cacerts\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.136760 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.135596 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.136760 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.135629 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b0114-e725-49be-8aba-14b550f55fa5-local-certs\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.136760 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.135673 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.136760 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.135706 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgj4g\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-kube-api-access-qgj4g\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.136760 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.135738 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-token\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.220014 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.219924 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jkwmq"] Jul 20 04:49:21.223091 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:49:21.223057 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c50a1a8_1ad8_44cd_bc45_9ff5a0bc08bd.slice/crio-f4be832da350617f40aa8ea54a31a751d4f4251873ebea0f7aaafbc5dd619b10 WatchSource:0}: Error finding container f4be832da350617f40aa8ea54a31a751d4f4251873ebea0f7aaafbc5dd619b10: Status 404 returned error can't find the container with id f4be832da350617f40aa8ea54a31a751d4f4251873ebea0f7aaafbc5dd619b10 Jul 20 04:49:21.236411 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.236378 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgj4g\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-kube-api-access-qgj4g\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.236551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.236431 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-token\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.236551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.236486 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.236551 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.236535 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-cacerts\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.236757 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.236578 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.236757 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.236641 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b0114-e725-49be-8aba-14b550f55fa5-local-certs\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.236757 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.236710 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.237676 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.237423 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.239501 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.239477 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.239599 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.239515 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b0114-e725-49be-8aba-14b550f55fa5-local-certs\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.239695 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.239674 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.239770 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.239746 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-cacerts\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.244787 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.244688 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgj4g\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-kube-api-access-qgj4g\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.244787 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.244735 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-token\") pod \"istiod-openshift-gateway-7574459656-9jxjg\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.314778 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.314738 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:21.475868 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.475841 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg"] Jul 20 04:49:21.478249 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:49:21.478218 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3b0114_e725_49be_8aba_14b550f55fa5.slice/crio-78c976fcbcfad0f55bf46a9c8ed9ce1d26eeabf6e02dc77f1cbb7ef34c03310e WatchSource:0}: Error finding container 78c976fcbcfad0f55bf46a9c8ed9ce1d26eeabf6e02dc77f1cbb7ef34c03310e: Status 404 returned error can't find the container with id 78c976fcbcfad0f55bf46a9c8ed9ce1d26eeabf6e02dc77f1cbb7ef34c03310e Jul 20 04:49:21.865188 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.865153 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" event={"ID":"6e21346e-fdef-4a5a-9e57-7c33900983d3","Type":"ContainerStarted","Data":"ac936c25ce46c9a67acfb9182a05ae86b693cc3970be5895fdf2ab51ab078241"} Jul 20 04:49:21.866795 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.866714 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" event={"ID":"ac3b0114-e725-49be-8aba-14b550f55fa5","Type":"ContainerStarted","Data":"78c976fcbcfad0f55bf46a9c8ed9ce1d26eeabf6e02dc77f1cbb7ef34c03310e"} Jul 20 04:49:21.868618 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:21.868548 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" event={"ID":"0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd","Type":"ContainerStarted","Data":"f4be832da350617f40aa8ea54a31a751d4f4251873ebea0f7aaafbc5dd619b10"} Jul 20 04:49:25.445368 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.445327 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 04:49:25.445685 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.445411 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 04:49:25.891229 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.890986 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" event={"ID":"6e21346e-fdef-4a5a-9e57-7c33900983d3","Type":"ContainerStarted","Data":"d576bea99f9a86de4aef44558caeaace15e9fb6ac04e112f1c49f6c8f4dcdf54"} Jul 20 04:49:25.891229 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.891189 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:25.893212 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.892812 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" event={"ID":"65f36e02-96f6-43d5-b325-423a1e061a13","Type":"ContainerStarted","Data":"f3d5363c176b58484c1187c2b205c7431e231f6bb9d14627afc8adf38b9e1599"} Jul 20 04:49:25.894629 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.894595 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" event={"ID":"ac3b0114-e725-49be-8aba-14b550f55fa5","Type":"ContainerStarted","Data":"9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33"} Jul 20 04:49:25.894751 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.894733 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:25.896769 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.896728 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" event={"ID":"0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd","Type":"ContainerStarted","Data":"3d82216046656eeffbd4097ce4b579bf1fdda42f456e16e23414a015fe93eba4"} Jul 20 04:49:25.896897 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.896877 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:25.906618 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.906575 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" podStartSLOduration=2.535065016 podStartE2EDuration="6.906563551s" totalImagesPullingTime="4.371498535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:49:25.906213798 +0000 UTC m=+567.737543925" watchObservedRunningTime="2026-07-20 04:49:25.906563551 +0000 UTC m=+567.737893634" Jul 20 04:49:25.921706 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.921658 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ff6d67bdf-cpcng" podStartSLOduration=1.648813966 podStartE2EDuration="6.921644421s" totalImagesPullingTime="5.272830455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:49:25.920445127 +0000 UTC m=+567.751775232" watchObservedRunningTime="2026-07-20 04:49:25.921644421 +0000 UTC m=+567.752974525" Jul 20 04:49:25.939726 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.939641 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" podStartSLOduration=1.975310113 podStartE2EDuration="5.939622332s" totalImagesPullingTime="3.964312219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:49:25.938347997 +0000 UTC m=+567.769678290" watchObservedRunningTime="2026-07-20 04:49:25.939622332 +0000 UTC m=+567.770952437" Jul 20 04:49:25.953678 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:25.953626 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" podStartSLOduration=1.797100397 podStartE2EDuration="5.95361097s" totalImagesPullingTime="4.156510573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:49:25.952182398 +0000 UTC m=+567.783512529" watchObservedRunningTime="2026-07-20 04:49:25.95361097 +0000 UTC m=+567.784941075" Jul 20 04:49:26.903368 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:26.903338 2553 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9jxjg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 04:49:26.903809 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:26.903392 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" podUID="ac3b0114-e725-49be-8aba-14b550f55fa5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 04:49:27.009504 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.009467 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r"] Jul 20 04:49:27.013323 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.013286 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.016019 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.015999 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9hszm\"" Jul 20 04:49:27.024067 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.024039 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r"] Jul 20 04:49:27.093841 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.093802 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b179b9a7-56a8-4112-a2a7-484817551390-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.094017 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.093853 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.094017 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.093939 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.094017 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.093982 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.094204 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.094086 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.094204 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.094131 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.094204 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.094161 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.094411 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.094258 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b179b9a7-56a8-4112-a2a7-484817551390-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.094411 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.094391 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsj26\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-kube-api-access-wsj26\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.194858 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.194773 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.194858 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.194809 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.194858 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.194829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.194858 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.194857 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b179b9a7-56a8-4112-a2a7-484817551390-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195200 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.194891 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsj26\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-kube-api-access-wsj26\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195200 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.194947 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b179b9a7-56a8-4112-a2a7-484817551390-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195200 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.194970 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195200 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.194996 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195200 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.195027 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.195226 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.195267 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.195392 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.195471 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.195705 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.195681 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b179b9a7-56a8-4112-a2a7-484817551390-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.197590 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.197569 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.197815 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.197795 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b179b9a7-56a8-4112-a2a7-484817551390-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.208406 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.208375 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsj26\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-kube-api-access-wsj26\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.208848 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.208827 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.221826 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.221795 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7"] Jul 20 04:49:27.226436 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.226414 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.235982 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.235956 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7"] Jul 20 04:49:27.298794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.296230 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.298794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.296367 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.298794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.296414 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.298794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.296449 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.298794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.296502 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9nnw\" (UniqueName: \"kubernetes.io/projected/f5a45e55-1969-49b7-9aeb-02076bf91a9b-kube-api-access-d9nnw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.298794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.296576 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.298794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.296601 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.298794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.296640 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.298794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.296700 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.324826 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.324795 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:27.411639 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.397604 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.411806 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.411728 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.411806 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.411780 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.411914 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.411812 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.411914 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.411841 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.411914 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.411894 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9nnw\" (UniqueName: \"kubernetes.io/projected/f5a45e55-1969-49b7-9aeb-02076bf91a9b-kube-api-access-d9nnw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.412049 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.411965 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.412049 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.411988 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.412049 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.412026 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.412839 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.412808 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.413681 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.413653 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.414124 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.414064 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.414226 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.414202 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.414636 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.414606 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.417341 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.416571 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.420715 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.420680 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.421206 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.421185 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5a45e55-1969-49b7-9aeb-02076bf91a9b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.422427 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.422405 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9nnw\" (UniqueName: \"kubernetes.io/projected/f5a45e55-1969-49b7-9aeb-02076bf91a9b-kube-api-access-d9nnw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gc6v7\" (UID: \"f5a45e55-1969-49b7-9aeb-02076bf91a9b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.488374 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.488349 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r"] Jul 20 04:49:27.490540 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:49:27.490512 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb179b9a7_56a8_4112_a2a7_484817551390.slice/crio-5096bc0ae6db417fc99e7aebe7f6bd372a20a0d2c966d625b2be7d8252393f6f WatchSource:0}: Error finding container 5096bc0ae6db417fc99e7aebe7f6bd372a20a0d2c966d625b2be7d8252393f6f: Status 404 returned error can't find the container with id 5096bc0ae6db417fc99e7aebe7f6bd372a20a0d2c966d625b2be7d8252393f6f Jul 20 04:49:27.539638 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.539607 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:27.684055 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.684028 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7"] Jul 20 04:49:27.686576 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:49:27.686549 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a45e55_1969_49b7_9aeb_02076bf91a9b.slice/crio-532696d0c4c88180b8a2e3ed156bf23ce97bcd3cc07e0ad8aed6b4e18c828f54 WatchSource:0}: Error finding container 532696d0c4c88180b8a2e3ed156bf23ce97bcd3cc07e0ad8aed6b4e18c828f54: Status 404 returned error can't find the container with id 532696d0c4c88180b8a2e3ed156bf23ce97bcd3cc07e0ad8aed6b4e18c828f54 Jul 20 04:49:27.908153 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.908116 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" event={"ID":"b179b9a7-56a8-4112-a2a7-484817551390","Type":"ContainerStarted","Data":"5096bc0ae6db417fc99e7aebe7f6bd372a20a0d2c966d625b2be7d8252393f6f"} Jul 20 04:49:27.909356 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:27.909325 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" event={"ID":"f5a45e55-1969-49b7-9aeb-02076bf91a9b","Type":"ContainerStarted","Data":"532696d0c4c88180b8a2e3ed156bf23ce97bcd3cc07e0ad8aed6b4e18c828f54"} Jul 20 04:49:29.467790 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.467755 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ckp69"] Jul 20 04:49:29.475335 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.474924 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:29.478725 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.478647 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 20 04:49:29.479640 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.479438 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mr5k6\"" Jul 20 04:49:29.481078 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.481044 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ckp69"] Jul 20 04:49:29.483807 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.483786 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh"] Jul 20 04:49:29.489909 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.487527 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:29.490402 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.490246 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 20 04:49:29.490402 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.490256 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9878x\"" Jul 20 04:49:29.495520 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.495453 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh"] Jul 20 04:49:29.528970 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.528921 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5176e93a-df19-49d1-a1aa-313e733b78ff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wg8fh\" (UID: \"5176e93a-df19-49d1-a1aa-313e733b78ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:29.529158 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.529065 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtnjl\" (UniqueName: \"kubernetes.io/projected/5176e93a-df19-49d1-a1aa-313e733b78ff-kube-api-access-wtnjl\") pod \"llmisvc-controller-manager-777c6bd7d5-wg8fh\" (UID: \"5176e93a-df19-49d1-a1aa-313e733b78ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:29.630455 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.630415 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj956\" (UniqueName: \"kubernetes.io/projected/5ff97844-9186-4fce-ab16-f07a67f62914-kube-api-access-dj956\") pod \"kserve-controller-manager-d6f4b65b8-ckp69\" (UID: \"5ff97844-9186-4fce-ab16-f07a67f62914\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:29.630634 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.630494 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtnjl\" (UniqueName: \"kubernetes.io/projected/5176e93a-df19-49d1-a1aa-313e733b78ff-kube-api-access-wtnjl\") pod \"llmisvc-controller-manager-777c6bd7d5-wg8fh\" (UID: \"5176e93a-df19-49d1-a1aa-313e733b78ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:29.630634 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.630622 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5176e93a-df19-49d1-a1aa-313e733b78ff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wg8fh\" (UID: \"5176e93a-df19-49d1-a1aa-313e733b78ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:29.630759 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.630657 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff97844-9186-4fce-ab16-f07a67f62914-cert\") pod \"kserve-controller-manager-d6f4b65b8-ckp69\" (UID: \"5ff97844-9186-4fce-ab16-f07a67f62914\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:29.630813 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:49:29.630799 2553 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 20 04:49:29.630886 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:49:29.630865 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5176e93a-df19-49d1-a1aa-313e733b78ff-cert podName:5176e93a-df19-49d1-a1aa-313e733b78ff nodeName:}" failed. No retries permitted until 2026-07-20 04:49:30.13084484 +0000 UTC m=+571.962174940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5176e93a-df19-49d1-a1aa-313e733b78ff-cert") pod "llmisvc-controller-manager-777c6bd7d5-wg8fh" (UID: "5176e93a-df19-49d1-a1aa-313e733b78ff") : secret "llmisvc-webhook-server-cert" not found Jul 20 04:49:29.639968 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.639937 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtnjl\" (UniqueName: \"kubernetes.io/projected/5176e93a-df19-49d1-a1aa-313e733b78ff-kube-api-access-wtnjl\") pod \"llmisvc-controller-manager-777c6bd7d5-wg8fh\" (UID: \"5176e93a-df19-49d1-a1aa-313e733b78ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:29.731993 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.731901 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff97844-9186-4fce-ab16-f07a67f62914-cert\") pod \"kserve-controller-manager-d6f4b65b8-ckp69\" (UID: \"5ff97844-9186-4fce-ab16-f07a67f62914\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:29.731993 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.731985 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj956\" (UniqueName: \"kubernetes.io/projected/5ff97844-9186-4fce-ab16-f07a67f62914-kube-api-access-dj956\") pod \"kserve-controller-manager-d6f4b65b8-ckp69\" (UID: \"5ff97844-9186-4fce-ab16-f07a67f62914\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:29.732210 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:49:29.732102 2553 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 20 04:49:29.732210 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:49:29.732177 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ff97844-9186-4fce-ab16-f07a67f62914-cert podName:5ff97844-9186-4fce-ab16-f07a67f62914 nodeName:}" failed. No retries permitted until 2026-07-20 04:49:30.232157037 +0000 UTC m=+572.063487141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ff97844-9186-4fce-ab16-f07a67f62914-cert") pod "kserve-controller-manager-d6f4b65b8-ckp69" (UID: "5ff97844-9186-4fce-ab16-f07a67f62914") : secret "kserve-webhook-server-cert" not found Jul 20 04:49:29.745809 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.745771 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj956\" (UniqueName: \"kubernetes.io/projected/5ff97844-9186-4fce-ab16-f07a67f62914-kube-api-access-dj956\") pod \"kserve-controller-manager-d6f4b65b8-ckp69\" (UID: \"5ff97844-9186-4fce-ab16-f07a67f62914\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:29.902760 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:29.902722 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:30.134899 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.134864 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5176e93a-df19-49d1-a1aa-313e733b78ff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wg8fh\" (UID: \"5176e93a-df19-49d1-a1aa-313e733b78ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:30.137544 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.137513 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5176e93a-df19-49d1-a1aa-313e733b78ff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wg8fh\" (UID: \"5176e93a-df19-49d1-a1aa-313e733b78ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:30.228507 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.228465 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 04:49:30.228664 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.228547 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 04:49:30.228664 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.228592 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 04:49:30.234960 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.234923 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 04:49:30.235043 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.235011 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 04:49:30.235078 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.235057 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 04:49:30.235804 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.235785 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff97844-9186-4fce-ab16-f07a67f62914-cert\") pod \"kserve-controller-manager-d6f4b65b8-ckp69\" (UID: \"5ff97844-9186-4fce-ab16-f07a67f62914\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:30.238579 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.238555 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff97844-9186-4fce-ab16-f07a67f62914-cert\") pod \"kserve-controller-manager-d6f4b65b8-ckp69\" (UID: \"5ff97844-9186-4fce-ab16-f07a67f62914\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:30.391623 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.391544 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:30.408448 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.408420 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:30.575198 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.575077 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ckp69"] Jul 20 04:49:30.576605 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:49:30.576550 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff97844_9186_4fce_ab16_f07a67f62914.slice/crio-de7b3aabe4c4ba8354214a1e372593b48e741c64d5380d6fa27e9365bd713905 WatchSource:0}: Error finding container de7b3aabe4c4ba8354214a1e372593b48e741c64d5380d6fa27e9365bd713905: Status 404 returned error can't find the container with id de7b3aabe4c4ba8354214a1e372593b48e741c64d5380d6fa27e9365bd713905 Jul 20 04:49:30.588419 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.588395 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh"] Jul 20 04:49:30.591266 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:49:30.591244 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5176e93a_df19_49d1_a1aa_313e733b78ff.slice/crio-368d248d82822cba1fc9cddb738502009746cf5100b0e5c87cc1393047cfae8d WatchSource:0}: Error finding container 368d248d82822cba1fc9cddb738502009746cf5100b0e5c87cc1393047cfae8d: Status 404 returned error can't find the container with id 368d248d82822cba1fc9cddb738502009746cf5100b0e5c87cc1393047cfae8d Jul 20 04:49:30.930615 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.930575 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" event={"ID":"5ff97844-9186-4fce-ab16-f07a67f62914","Type":"ContainerStarted","Data":"de7b3aabe4c4ba8354214a1e372593b48e741c64d5380d6fa27e9365bd713905"} Jul 20 04:49:30.932447 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.932411 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" event={"ID":"b179b9a7-56a8-4112-a2a7-484817551390","Type":"ContainerStarted","Data":"008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a"} Jul 20 04:49:30.934209 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.934180 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" event={"ID":"f5a45e55-1969-49b7-9aeb-02076bf91a9b","Type":"ContainerStarted","Data":"b3bc23594bbc073412c3a8a0771b64fe33c6894c391d121dae8c3c09a632cb78"} Jul 20 04:49:30.935253 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.935231 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" event={"ID":"5176e93a-df19-49d1-a1aa-313e733b78ff","Type":"ContainerStarted","Data":"368d248d82822cba1fc9cddb738502009746cf5100b0e5c87cc1393047cfae8d"} Jul 20 04:49:30.953479 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.953429 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" podStartSLOduration=2.217958269 podStartE2EDuration="4.953410778s" totalImagesPullingTime="2.735452509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:49:30.953266074 +0000 UTC m=+572.784596183" watchObservedRunningTime="2026-07-20 04:49:30.953410778 +0000 UTC m=+572.784740884" Jul 20 04:49:30.974739 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:30.974687 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" podStartSLOduration=1.42873612 podStartE2EDuration="3.97467037s" totalImagesPullingTime="2.54593425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:49:30.973683927 +0000 UTC m=+572.805014033" watchObservedRunningTime="2026-07-20 04:49:30.97467037 +0000 UTC m=+572.806000474" Jul 20 04:49:31.325581 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:31.325454 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:31.327271 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:31.327228 2553 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 04:49:31.327446 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:31.327332 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" podUID="b179b9a7-56a8-4112-a2a7-484817551390" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 04:49:31.540282 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:31.540243 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:31.546399 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:31.546342 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:31.942602 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:31.942563 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:31.943646 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:31.943612 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gc6v7" Jul 20 04:49:31.991425 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:31.991382 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r"] Jul 20 04:49:32.325627 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:32.325544 2553 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 04:49:32.325777 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:32.325627 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" podUID="b179b9a7-56a8-4112-a2a7-484817551390" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 04:49:33.325562 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:33.325521 2553 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 04:49:33.326022 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:33.325601 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" podUID="b179b9a7-56a8-4112-a2a7-484817551390" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 04:49:33.953104 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:33.953068 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" event={"ID":"5176e93a-df19-49d1-a1aa-313e733b78ff","Type":"ContainerStarted","Data":"7065abc1e64ebbd5d3040a95185aed285a312d74cac428f61686c3f361e51d06"} Jul 20 04:49:33.953277 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:33.953171 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:49:33.954659 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:33.954636 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" event={"ID":"5ff97844-9186-4fce-ab16-f07a67f62914","Type":"ContainerStarted","Data":"ab03eaee56adffd1326a76266a47913cd423fa2b500e148532883bc5667a8d62"} Jul 20 04:49:33.954798 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:33.954781 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:49:33.954888 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:33.954869 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" podUID="b179b9a7-56a8-4112-a2a7-484817551390" containerName="istio-proxy" containerID="cri-o://008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a" gracePeriod=30 Jul 20 04:49:33.968199 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:33.968158 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" podStartSLOduration=2.040519331 podStartE2EDuration="4.968144021s" totalImagesPullingTime="2.92762469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:49:33.9666247 +0000 UTC m=+575.797954820" watchObservedRunningTime="2026-07-20 04:49:33.968144021 +0000 UTC m=+575.799474163" Jul 20 04:49:34.004943 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.004872 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" podStartSLOduration=2.066379203 podStartE2EDuration="5.00485561s" totalImagesPullingTime="2.938476407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:49:33.998102233 +0000 UTC m=+575.829432342" watchObservedRunningTime="2026-07-20 04:49:34.00485561 +0000 UTC m=+575.836185715" Jul 20 04:49:34.149763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.149716 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg"] Jul 20 04:49:34.150002 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.149979 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" podUID="ac3b0114-e725-49be-8aba-14b550f55fa5" containerName="discovery" containerID="cri-o://9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33" gracePeriod=30 Jul 20 04:49:34.399679 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.399648 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:34.477138 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.476604 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-ca-configmap\") pod \"ac3b0114-e725-49be-8aba-14b550f55fa5\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " Jul 20 04:49:34.477138 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.476667 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b0114-e725-49be-8aba-14b550f55fa5-local-certs\") pod \"ac3b0114-e725-49be-8aba-14b550f55fa5\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " Jul 20 04:49:34.477138 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.476695 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgj4g\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-kube-api-access-qgj4g\") pod \"ac3b0114-e725-49be-8aba-14b550f55fa5\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " Jul 20 04:49:34.477138 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.476746 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-token\") pod \"ac3b0114-e725-49be-8aba-14b550f55fa5\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " Jul 20 04:49:34.477138 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.476770 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-cacerts\") pod \"ac3b0114-e725-49be-8aba-14b550f55fa5\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " Jul 20 04:49:34.477138 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.476811 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-kubeconfig\") pod \"ac3b0114-e725-49be-8aba-14b550f55fa5\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " Jul 20 04:49:34.477138 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.476883 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-dns-cert\") pod \"ac3b0114-e725-49be-8aba-14b550f55fa5\" (UID: \"ac3b0114-e725-49be-8aba-14b550f55fa5\") " Jul 20 04:49:34.482267 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.481603 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ac3b0114-e725-49be-8aba-14b550f55fa5" (UID: "ac3b0114-e725-49be-8aba-14b550f55fa5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:49:34.482267 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.482111 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac3b0114-e725-49be-8aba-14b550f55fa5" (UID: "ac3b0114-e725-49be-8aba-14b550f55fa5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 04:49:34.491497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.487589 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ac3b0114-e725-49be-8aba-14b550f55fa5" (UID: "ac3b0114-e725-49be-8aba-14b550f55fa5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:49:34.491497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.487696 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-kube-api-access-qgj4g" (OuterVolumeSpecName: "kube-api-access-qgj4g") pod "ac3b0114-e725-49be-8aba-14b550f55fa5" (UID: "ac3b0114-e725-49be-8aba-14b550f55fa5"). InnerVolumeSpecName "kube-api-access-qgj4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 04:49:34.491497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.489175 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-cacerts" (OuterVolumeSpecName: "cacerts") pod "ac3b0114-e725-49be-8aba-14b550f55fa5" (UID: "ac3b0114-e725-49be-8aba-14b550f55fa5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:49:34.491497 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.491467 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ac3b0114-e725-49be-8aba-14b550f55fa5" (UID: "ac3b0114-e725-49be-8aba-14b550f55fa5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 04:49:34.492145 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.492106 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b0114-e725-49be-8aba-14b550f55fa5-local-certs" (OuterVolumeSpecName: "local-certs") pod "ac3b0114-e725-49be-8aba-14b550f55fa5" (UID: "ac3b0114-e725-49be-8aba-14b550f55fa5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 04:49:34.577586 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.577558 2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-ca-configmap\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:34.577586 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.577585 2553 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b0114-e725-49be-8aba-14b550f55fa5-local-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:34.577586 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.577595 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgj4g\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-kube-api-access-qgj4g\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:34.577815 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.577607 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-token\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:34.577815 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.577621 2553 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-cacerts\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:34.577815 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.577631 2553 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-kubeconfig\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:34.577815 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.577638 2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac3b0114-e725-49be-8aba-14b550f55fa5-istio-csr-dns-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:34.960922 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.960888 2553 generic.go:356] "Generic (PLEG): container finished" podID="ac3b0114-e725-49be-8aba-14b550f55fa5" containerID="9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33" exitCode=0 Jul 20 04:49:34.961087 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.960937 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" Jul 20 04:49:34.961087 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.960971 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" event={"ID":"ac3b0114-e725-49be-8aba-14b550f55fa5","Type":"ContainerDied","Data":"9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33"} Jul 20 04:49:34.961087 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.961018 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg" event={"ID":"ac3b0114-e725-49be-8aba-14b550f55fa5","Type":"ContainerDied","Data":"78c976fcbcfad0f55bf46a9c8ed9ce1d26eeabf6e02dc77f1cbb7ef34c03310e"} Jul 20 04:49:34.961087 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.961045 2553 scope.go:117] "RemoveContainer" containerID="9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33" Jul 20 04:49:34.970605 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.970583 2553 scope.go:117] "RemoveContainer" containerID="9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33" Jul 20 04:49:34.970907 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:49:34.970880 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33\": container with ID starting with 9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33 not found: ID does not exist" containerID="9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33" Jul 20 04:49:34.970969 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.970911 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33"} err="failed to get container status \"9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33\": rpc error: code = NotFound desc = could not find container \"9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33\": container with ID starting with 9df40f3a4f2e369c655d4edf49a7559973a567473472970087428d2f66825f33 not found: ID does not exist" Jul 20 04:49:34.978511 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.978481 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg"] Jul 20 04:49:34.983424 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:34.983400 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9jxjg"] Jul 20 04:49:36.696945 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:36.696900 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac3b0114-e725-49be-8aba-14b550f55fa5" path="/var/lib/kubelet/pods/ac3b0114-e725-49be-8aba-14b550f55fa5/volumes" Jul 20 04:49:36.904377 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:36.904352 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-snqz5" Jul 20 04:49:36.906344 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:36.906299 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jkwmq" Jul 20 04:49:39.215159 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.215092 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:39.324386 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324348 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-envoy\") pod \"b179b9a7-56a8-4112-a2a7-484817551390\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " Jul 20 04:49:39.324563 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324447 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-socket\") pod \"b179b9a7-56a8-4112-a2a7-484817551390\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " Jul 20 04:49:39.324563 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324484 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b179b9a7-56a8-4112-a2a7-484817551390-istio-podinfo\") pod \"b179b9a7-56a8-4112-a2a7-484817551390\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " Jul 20 04:49:39.324563 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324545 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b179b9a7-56a8-4112-a2a7-484817551390-istiod-ca-cert\") pod \"b179b9a7-56a8-4112-a2a7-484817551390\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " Jul 20 04:49:39.324739 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324574 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-data\") pod \"b179b9a7-56a8-4112-a2a7-484817551390\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " Jul 20 04:49:39.324739 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324619 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-credential-socket\") pod \"b179b9a7-56a8-4112-a2a7-484817551390\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " Jul 20 04:49:39.324739 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324644 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsj26\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-kube-api-access-wsj26\") pod \"b179b9a7-56a8-4112-a2a7-484817551390\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " Jul 20 04:49:39.324739 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324683 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-istio-token\") pod \"b179b9a7-56a8-4112-a2a7-484817551390\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " Jul 20 04:49:39.324739 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324688 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b179b9a7-56a8-4112-a2a7-484817551390" (UID: "b179b9a7-56a8-4112-a2a7-484817551390"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 04:49:39.324739 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324736 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-certs\") pod \"b179b9a7-56a8-4112-a2a7-484817551390\" (UID: \"b179b9a7-56a8-4112-a2a7-484817551390\") " Jul 20 04:49:39.325054 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324953 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b179b9a7-56a8-4112-a2a7-484817551390" (UID: "b179b9a7-56a8-4112-a2a7-484817551390"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 04:49:39.325054 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324981 2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-socket\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:39.325054 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.324995 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b179b9a7-56a8-4112-a2a7-484817551390-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b179b9a7-56a8-4112-a2a7-484817551390" (UID: "b179b9a7-56a8-4112-a2a7-484817551390"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 04:49:39.325054 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.325027 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-data" (OuterVolumeSpecName: "istio-data") pod "b179b9a7-56a8-4112-a2a7-484817551390" (UID: "b179b9a7-56a8-4112-a2a7-484817551390"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 04:49:39.325248 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.325186 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b179b9a7-56a8-4112-a2a7-484817551390" (UID: "b179b9a7-56a8-4112-a2a7-484817551390"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 04:49:39.326813 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.326783 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b179b9a7-56a8-4112-a2a7-484817551390" (UID: "b179b9a7-56a8-4112-a2a7-484817551390"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 04:49:39.326971 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.326952 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-kube-api-access-wsj26" (OuterVolumeSpecName: "kube-api-access-wsj26") pod "b179b9a7-56a8-4112-a2a7-484817551390" (UID: "b179b9a7-56a8-4112-a2a7-484817551390"). InnerVolumeSpecName "kube-api-access-wsj26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 04:49:39.326971 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.326956 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b179b9a7-56a8-4112-a2a7-484817551390-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b179b9a7-56a8-4112-a2a7-484817551390" (UID: "b179b9a7-56a8-4112-a2a7-484817551390"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 04:49:39.327067 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.327038 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-istio-token" (OuterVolumeSpecName: "istio-token") pod "b179b9a7-56a8-4112-a2a7-484817551390" (UID: "b179b9a7-56a8-4112-a2a7-484817551390"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 04:49:39.425671 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.425633 2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b179b9a7-56a8-4112-a2a7-484817551390-istio-podinfo\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:39.425671 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.425665 2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b179b9a7-56a8-4112-a2a7-484817551390-istiod-ca-cert\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:39.425671 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.425674 2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-data\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:39.425671 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.425682 2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-credential-socket\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:39.425946 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.425691 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsj26\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-kube-api-access-wsj26\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:39.425946 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.425701 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b179b9a7-56a8-4112-a2a7-484817551390-istio-token\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:39.425946 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.425709 2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-workload-certs\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:39.425946 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.425717 2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b179b9a7-56a8-4112-a2a7-484817551390-istio-envoy\") on node \"ip-10-0-139-1.ec2.internal\" DevicePath \"\"" Jul 20 04:49:39.991893 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.991850 2553 generic.go:356] "Generic (PLEG): container finished" podID="b179b9a7-56a8-4112-a2a7-484817551390" containerID="008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a" exitCode=0 Jul 20 04:49:39.992099 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.991905 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" Jul 20 04:49:39.992099 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.991928 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" event={"ID":"b179b9a7-56a8-4112-a2a7-484817551390","Type":"ContainerDied","Data":"008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a"} Jul 20 04:49:39.992099 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.992018 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r" event={"ID":"b179b9a7-56a8-4112-a2a7-484817551390","Type":"ContainerDied","Data":"5096bc0ae6db417fc99e7aebe7f6bd372a20a0d2c966d625b2be7d8252393f6f"} Jul 20 04:49:39.992099 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:39.992053 2553 scope.go:117] "RemoveContainer" containerID="008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a" Jul 20 04:49:40.002248 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:40.002220 2553 scope.go:117] "RemoveContainer" containerID="008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a" Jul 20 04:49:40.002586 ip-10-0-139-1 kubenswrapper[2553]: E0720 04:49:40.002565 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a\": container with ID starting with 008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a not found: ID does not exist" containerID="008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a" Jul 20 04:49:40.002682 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:40.002599 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a"} err="failed to get container status \"008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a\": rpc error: code = NotFound desc = could not find container \"008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a\": container with ID starting with 008d414ee0b502eb62f1aa4e9305275079a99b265077e1ccf922a25ad62cf58a not found: ID does not exist" Jul 20 04:49:40.013927 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:40.013852 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r"] Jul 20 04:49:40.015934 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:40.015906 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s4d4r"] Jul 20 04:49:40.696940 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:40.696908 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b179b9a7-56a8-4112-a2a7-484817551390" path="/var/lib/kubelet/pods/b179b9a7-56a8-4112-a2a7-484817551390/volumes" Jul 20 04:49:58.664937 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:58.664908 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:49:58.665276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:58.664967 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:49:58.669603 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:58.669579 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:49:58.669699 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:49:58.669658 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:50:04.964169 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:50:04.964126 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wg8fh" Jul 20 04:50:04.969164 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:50:04.967268 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ckp69" Jul 20 04:54:58.696695 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:54:58.696583 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:54:58.704202 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:54:58.704177 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:54:58.706659 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:54:58.706635 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:54:58.709217 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:54:58.709197 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:59:29.225276 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:29.225241 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ckp69_5ff97844-9186-4fce-ab16-f07a67f62914/manager/0.log" Jul 20 04:59:29.335634 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:29.335601 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wg8fh_5176e93a-df19-49d1-a1aa-313e733b78ff/manager/0.log" Jul 20 04:59:29.444519 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:29.444494 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jkwmq_0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd/server/0.log" Jul 20 04:59:29.567096 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:29.566979 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-snqz5_6e21346e-fdef-4a5a-9e57-7c33900983d3/manager/0.log" Jul 20 04:59:29.676997 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:29.676969 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bbbb7cf9b-khmxc_7539339c-7389-44f0-8214-09aaffa0f607/copy-manifests/0.log" Jul 20 04:59:29.683663 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:29.683639 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bbbb7cf9b-khmxc_7539339c-7389-44f0-8214-09aaffa0f607/manager/0.log" Jul 20 04:59:30.777980 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:30.777953 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gc6v7_f5a45e55-1969-49b7-9aeb-02076bf91a9b/istio-proxy/0.log" Jul 20 04:59:31.004139 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:31.004096 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6d67bdf-cpcng_65f36e02-96f6-43d5-b325-423a1e061a13/kube-auth-proxy/0.log" Jul 20 04:59:36.512030 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.511991 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hppk8/must-gather-gkn9d"] Jul 20 04:59:36.512531 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.512483 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b179b9a7-56a8-4112-a2a7-484817551390" containerName="istio-proxy" Jul 20 04:59:36.512531 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.512501 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b179b9a7-56a8-4112-a2a7-484817551390" containerName="istio-proxy" Jul 20 04:59:36.512650 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.512543 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac3b0114-e725-49be-8aba-14b550f55fa5" containerName="discovery" Jul 20 04:59:36.512650 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.512552 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac3b0114-e725-49be-8aba-14b550f55fa5" containerName="discovery" Jul 20 04:59:36.512650 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.512631 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b179b9a7-56a8-4112-a2a7-484817551390" containerName="istio-proxy" Jul 20 04:59:36.512650 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.512648 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac3b0114-e725-49be-8aba-14b550f55fa5" containerName="discovery" Jul 20 04:59:36.515896 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.515874 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hppk8/must-gather-gkn9d" Jul 20 04:59:36.518294 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.518272 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hppk8\"/\"kube-root-ca.crt\"" Jul 20 04:59:36.518294 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.518301 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hppk8\"/\"default-dockercfg-rgsr7\"" Jul 20 04:59:36.518480 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.518369 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hppk8\"/\"openshift-service-ca.crt\"" Jul 20 04:59:36.533714 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.533691 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hppk8/must-gather-gkn9d"] Jul 20 04:59:36.639698 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.639663 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlv7p\" (UniqueName: \"kubernetes.io/projected/2f607feb-3d83-4422-b521-5d95ba29e212-kube-api-access-wlv7p\") pod \"must-gather-gkn9d\" (UID: \"2f607feb-3d83-4422-b521-5d95ba29e212\") " pod="openshift-must-gather-hppk8/must-gather-gkn9d" Jul 20 04:59:36.639698 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.639710 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2f607feb-3d83-4422-b521-5d95ba29e212-must-gather-output\") pod \"must-gather-gkn9d\" (UID: \"2f607feb-3d83-4422-b521-5d95ba29e212\") " pod="openshift-must-gather-hppk8/must-gather-gkn9d" Jul 20 04:59:36.740981 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.740941 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlv7p\" (UniqueName: \"kubernetes.io/projected/2f607feb-3d83-4422-b521-5d95ba29e212-kube-api-access-wlv7p\") pod \"must-gather-gkn9d\" (UID: \"2f607feb-3d83-4422-b521-5d95ba29e212\") " pod="openshift-must-gather-hppk8/must-gather-gkn9d" Jul 20 04:59:36.741174 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.740997 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2f607feb-3d83-4422-b521-5d95ba29e212-must-gather-output\") pod \"must-gather-gkn9d\" (UID: \"2f607feb-3d83-4422-b521-5d95ba29e212\") " pod="openshift-must-gather-hppk8/must-gather-gkn9d" Jul 20 04:59:36.741390 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.741370 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2f607feb-3d83-4422-b521-5d95ba29e212-must-gather-output\") pod \"must-gather-gkn9d\" (UID: \"2f607feb-3d83-4422-b521-5d95ba29e212\") " pod="openshift-must-gather-hppk8/must-gather-gkn9d" Jul 20 04:59:36.749712 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.749676 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlv7p\" (UniqueName: \"kubernetes.io/projected/2f607feb-3d83-4422-b521-5d95ba29e212-kube-api-access-wlv7p\") pod \"must-gather-gkn9d\" (UID: \"2f607feb-3d83-4422-b521-5d95ba29e212\") " pod="openshift-must-gather-hppk8/must-gather-gkn9d" Jul 20 04:59:36.824595 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.824517 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hppk8/must-gather-gkn9d" Jul 20 04:59:36.960561 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.960429 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hppk8/must-gather-gkn9d"] Jul 20 04:59:36.962751 ip-10-0-139-1 kubenswrapper[2553]: W0720 04:59:36.962720 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f607feb_3d83_4422_b521_5d95ba29e212.slice/crio-11fdf6a6b158cf900e829b5a9657f0c78876ee8ab7d1b2f2e96858b058f01871 WatchSource:0}: Error finding container 11fdf6a6b158cf900e829b5a9657f0c78876ee8ab7d1b2f2e96858b058f01871: Status 404 returned error can't find the container with id 11fdf6a6b158cf900e829b5a9657f0c78876ee8ab7d1b2f2e96858b058f01871 Jul 20 04:59:36.964632 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:36.964612 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 04:59:37.657192 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:37.657161 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hppk8/must-gather-gkn9d" event={"ID":"2f607feb-3d83-4422-b521-5d95ba29e212","Type":"ContainerStarted","Data":"11fdf6a6b158cf900e829b5a9657f0c78876ee8ab7d1b2f2e96858b058f01871"} Jul 20 04:59:38.667116 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:38.667068 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hppk8/must-gather-gkn9d" event={"ID":"2f607feb-3d83-4422-b521-5d95ba29e212","Type":"ContainerStarted","Data":"a398f4bbcf1150003fd9a42bfb30c1e2e2c0920c4e906d3d8f8b2d90b209de65"} Jul 20 04:59:38.667528 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:38.667128 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hppk8/must-gather-gkn9d" event={"ID":"2f607feb-3d83-4422-b521-5d95ba29e212","Type":"ContainerStarted","Data":"3c492f6cdbcc17742424aeb297e59fef8f6b7d0cf94bdc3b3d66659e5202907b"} Jul 20 04:59:38.682368 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:38.682292 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hppk8/must-gather-gkn9d" podStartSLOduration=1.8239195320000001 podStartE2EDuration="2.682276102s" totalImagesPullingTime="858.35657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:38.681257622 +0000 UTC m=+1180.512587728" watchObservedRunningTime="2026-07-20 04:59:38.682276102 +0000 UTC m=+1180.513606236" Jul 20 04:59:39.340299 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:39.340269 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-htwc8_d9efa6ae-6769-4312-af64-b15c8d641f83/global-pull-secret-syncer/0.log" Jul 20 04:59:39.465331 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:39.465273 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4xdjb_401ea0f7-035a-4dcc-b506-14c3d5cf6a1d/konnectivity-agent/0.log" Jul 20 04:59:39.533382 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:39.533351 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-1.ec2.internal_4359bec0e352431350db386bdadf6398/haproxy/0.log" Jul 20 04:59:44.602126 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:44.602082 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-np29v_26140700-09b3-408f-8890-c7288274a145/monitoring-plugin/0.log" Jul 20 04:59:44.642526 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:44.642477 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhbm6_43293703-fb24-46ae-8ad5-ec55ebbbf5a7/node-exporter/0.log" Jul 20 04:59:44.663991 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:44.663965 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhbm6_43293703-fb24-46ae-8ad5-ec55ebbbf5a7/kube-rbac-proxy/0.log" Jul 20 04:59:44.686161 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:44.686138 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhbm6_43293703-fb24-46ae-8ad5-ec55ebbbf5a7/init-textfile/0.log" Jul 20 04:59:44.989198 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:44.989169 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb5bfdf-0269-433c-9c23-33462eb27ed8/prometheus/0.log" Jul 20 04:59:45.021327 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:45.021277 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb5bfdf-0269-433c-9c23-33462eb27ed8/config-reloader/0.log" Jul 20 04:59:45.054703 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:45.054670 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb5bfdf-0269-433c-9c23-33462eb27ed8/thanos-sidecar/0.log" Jul 20 04:59:45.079794 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:45.079767 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb5bfdf-0269-433c-9c23-33462eb27ed8/kube-rbac-proxy-web/0.log" Jul 20 04:59:45.101387 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:45.101350 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb5bfdf-0269-433c-9c23-33462eb27ed8/kube-rbac-proxy/0.log" Jul 20 04:59:45.132963 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:45.132936 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb5bfdf-0269-433c-9c23-33462eb27ed8/kube-rbac-proxy-thanos/0.log" Jul 20 04:59:45.159822 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:45.159800 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7cb5bfdf-0269-433c-9c23-33462eb27ed8/init-config-reloader/0.log" Jul 20 04:59:45.200688 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:45.200660 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tgggx_340745fa-e6a1-4c3f-b684-a8de32d99ee2/prometheus-operator/0.log" Jul 20 04:59:45.224229 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:45.224150 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tgggx_340745fa-e6a1-4c3f-b684-a8de32d99ee2/kube-rbac-proxy/0.log" Jul 20 04:59:47.805049 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:47.805009 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:59:47.814108 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:47.814005 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/3.log" Jul 20 04:59:48.832709 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:48.832665 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-p5lq2_dbba446d-f98d-4e41-8e02-7c03f5391120/volume-data-source-validator/0.log" Jul 20 04:59:49.182454 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.182420 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq"] Jul 20 04:59:49.188694 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.188667 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.195488 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.195445 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq"] Jul 20 04:59:49.289854 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.289808 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-podres\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.290213 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.289910 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-sys\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.290213 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.289960 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-proc\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.290213 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.290022 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-lib-modules\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.290213 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.290050 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8m4j\" (UniqueName: \"kubernetes.io/projected/293fd589-00dc-4881-9a9f-473626e5d316-kube-api-access-j8m4j\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.390997 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.390962 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-proc\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.391183 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.391022 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-lib-modules\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.391183 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.391052 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8m4j\" (UniqueName: \"kubernetes.io/projected/293fd589-00dc-4881-9a9f-473626e5d316-kube-api-access-j8m4j\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.391183 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.391083 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-podres\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.391183 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.391089 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-proc\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.391430 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.391189 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-podres\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.391430 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.391208 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-lib-modules\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.391430 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.391229 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-sys\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.391430 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.391260 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/293fd589-00dc-4881-9a9f-473626e5d316-sys\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.399661 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.399501 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8m4j\" (UniqueName: \"kubernetes.io/projected/293fd589-00dc-4881-9a9f-473626e5d316-kube-api-access-j8m4j\") pod \"perf-node-gather-daemonset-6t5xq\" (UID: \"293fd589-00dc-4881-9a9f-473626e5d316\") " pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.502377 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.502262 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:49.682354 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.682212 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq"] Jul 20 04:59:49.793060 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.793021 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" event={"ID":"293fd589-00dc-4881-9a9f-473626e5d316","Type":"ContainerStarted","Data":"08674bad5531a6f924f81eebdb35fc1b2db3efc977c5e8d7ef781972aa7da08b"} Jul 20 04:59:49.976983 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.976949 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7z4r_a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8/dns/0.log" Jul 20 04:59:49.996749 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:49.996718 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7z4r_a5bc31fe-d6e7-4a9c-b031-6e0526fa32b8/kube-rbac-proxy/0.log" Jul 20 04:59:50.041776 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:50.041697 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzb5h_827bf049-ea44-42b4-b2b3-ea4f2c141dda/dns-node-resolver/0.log" Jul 20 04:59:50.586231 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:50.586194 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5564b67776-xjd7x_baed8a99-889c-4d2f-9608-f0089d6f16df/registry/0.log" Jul 20 04:59:50.605001 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:50.604976 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5t9gn_eac9bab1-d00f-4b62-be3c-da339ba1c9b2/node-ca/0.log" Jul 20 04:59:50.799747 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:50.799712 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" event={"ID":"293fd589-00dc-4881-9a9f-473626e5d316","Type":"ContainerStarted","Data":"8c46cd87e429057f5b524a9ade35977bb5ff0f1c7874449f1a2c2e210f7ba2d8"} Jul 20 04:59:50.799936 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:50.799846 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:50.816207 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:50.816148 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" podStartSLOduration=1.816127304 podStartE2EDuration="1.816127304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:50.813919355 +0000 UTC m=+1192.645249462" watchObservedRunningTime="2026-07-20 04:59:50.816127304 +0000 UTC m=+1192.647457420" Jul 20 04:59:51.534185 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:51.534155 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gc6v7_f5a45e55-1969-49b7-9aeb-02076bf91a9b/istio-proxy/0.log" Jul 20 04:59:51.590071 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:51.590043 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6d67bdf-cpcng_65f36e02-96f6-43d5-b325-423a1e061a13/kube-auth-proxy/0.log" Jul 20 04:59:52.179087 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:52.179057 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84bb8_5265bc55-f1c7-4009-bd94-8e52da59a793/serve-healthcheck-canary/0.log" Jul 20 04:59:52.681970 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:52.681937 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jcd8d_f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc/insights-operator/1.log" Jul 20 04:59:52.682402 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:52.682060 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jcd8d_f6b49fd8-bd3c-48c0-a15a-119a55a4b5dc/insights-operator/0.log" Jul 20 04:59:52.829355 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:52.829327 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmc5h_419317e6-5dae-461c-a772-456b0e87a3b3/kube-rbac-proxy/0.log" Jul 20 04:59:52.849768 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:52.849737 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmc5h_419317e6-5dae-461c-a772-456b0e87a3b3/exporter/0.log" Jul 20 04:59:52.871025 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:52.870987 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmc5h_419317e6-5dae-461c-a772-456b0e87a3b3/extractor/0.log" Jul 20 04:59:54.759917 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:54.759878 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ckp69_5ff97844-9186-4fce-ab16-f07a67f62914/manager/0.log" Jul 20 04:59:54.784249 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:54.784214 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wg8fh_5176e93a-df19-49d1-a1aa-313e733b78ff/manager/0.log" Jul 20 04:59:54.805908 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:54.805882 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jkwmq_0c50a1a8-1ad8-44cd-bc45-9ff5a0bc08bd/server/0.log" Jul 20 04:59:54.872682 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:54.872650 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-snqz5_6e21346e-fdef-4a5a-9e57-7c33900983d3/manager/0.log" Jul 20 04:59:54.897566 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:54.897535 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bbbb7cf9b-khmxc_7539339c-7389-44f0-8214-09aaffa0f607/manager/0.log" Jul 20 04:59:54.916755 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:54.916726 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bbbb7cf9b-khmxc_7539339c-7389-44f0-8214-09aaffa0f607/copy-manifests/0.log" Jul 20 04:59:56.147830 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:56.147786 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cplld_59b1104d-f5b1-4d27-acfb-4c9877bb4f51/openshift-lws-operator/0.log" Jul 20 04:59:56.818273 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:56.818249 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hppk8/perf-node-gather-daemonset-6t5xq" Jul 20 04:59:58.772831 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:58.772744 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:59:58.778545 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:58.778517 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bfgpv_15097630-68a6-4704-9c96-2c619c3a76da/console-operator/2.log" Jul 20 04:59:58.783099 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:58.783073 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:59:58.789182 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:58.789158 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 04:59:59.644763 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:59.644729 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gc6v7_f5a45e55-1969-49b7-9aeb-02076bf91a9b/istio-proxy/0.log" Jul 20 04:59:59.679329 ip-10-0-139-1 kubenswrapper[2553]: I0720 04:59:59.679284 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6d67bdf-cpcng_65f36e02-96f6-43d5-b325-423a1e061a13/kube-auth-proxy/0.log" Jul 20 05:00:00.929511 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:00.929462 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gc6v7_f5a45e55-1969-49b7-9aeb-02076bf91a9b/istio-proxy/0.log" Jul 20 05:00:00.967880 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:00.967855 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff6d67bdf-cpcng_65f36e02-96f6-43d5-b325-423a1e061a13/kube-auth-proxy/0.log" Jul 20 05:00:03.225556 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.225515 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vsktp_23183526-71fe-40ba-b073-a0cd6fc654f4/kube-multus-additional-cni-plugins/0.log" Jul 20 05:00:03.248471 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.248431 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vsktp_23183526-71fe-40ba-b073-a0cd6fc654f4/egress-router-binary-copy/0.log" Jul 20 05:00:03.267923 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.267897 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vsktp_23183526-71fe-40ba-b073-a0cd6fc654f4/cni-plugins/0.log" Jul 20 05:00:03.290178 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.290149 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vsktp_23183526-71fe-40ba-b073-a0cd6fc654f4/bond-cni-plugin/0.log" Jul 20 05:00:03.312317 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.312287 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vsktp_23183526-71fe-40ba-b073-a0cd6fc654f4/routeoverride-cni/0.log" Jul 20 05:00:03.334329 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.334289 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vsktp_23183526-71fe-40ba-b073-a0cd6fc654f4/whereabouts-cni-bincopy/0.log" Jul 20 05:00:03.354676 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.354646 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vsktp_23183526-71fe-40ba-b073-a0cd6fc654f4/whereabouts-cni/0.log" Jul 20 05:00:03.391920 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.391892 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jbjt5_0feb6b46-1f57-4cac-b855-962c4bc18915/kube-multus/0.log" Jul 20 05:00:03.486237 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.486159 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v84j5_3673a269-04f3-4369-9467-fea04e2ddf96/network-metrics-daemon/0.log" Jul 20 05:00:03.504240 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:03.504216 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v84j5_3673a269-04f3-4369-9467-fea04e2ddf96/kube-rbac-proxy/0.log" Jul 20 05:00:04.529994 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:04.529942 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-controller/0.log" Jul 20 05:00:04.546286 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:04.546257 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/1.log" Jul 20 05:00:04.546459 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:04.546295 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovn-acl-logging/0.log" Jul 20 05:00:04.572981 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:04.572949 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/kube-rbac-proxy-node/0.log" Jul 20 05:00:04.599563 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:04.599520 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/kube-rbac-proxy-ovn-metrics/0.log" Jul 20 05:00:04.616320 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:04.616283 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/northd/0.log" Jul 20 05:00:04.635516 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:04.635451 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/nbdb/0.log" Jul 20 05:00:04.655787 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:04.655756 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/sbdb/0.log" Jul 20 05:00:04.711761 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:04.711720 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jb67f_8cdad8ad-2d4d-45ec-ba97-93620eb23ff3/ovnkube-controller/0.log" Jul 20 05:00:06.128044 ip-10-0-139-1 kubenswrapper[2553]: I0720 05:00:06.128018 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-b59px_d5bb0178-a4e8-479b-90a5-28827b1aca83/network-check-target-container/0.log"