Jun 13 03:41:36.573583 ip-10-0-133-206 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 13 03:41:36.573592 ip-10-0-133-206 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 13 03:41:36.573599 ip-10-0-133-206 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 13 03:41:36.573811 ip-10-0-133-206 systemd[1]: Failed to start Kubernetes Kubelet. Jun 13 03:41:46.647491 ip-10-0-133-206 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 13 03:41:46.647506 ip-10-0-133-206 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a1a08bb15d754d70b8199cefbeb5b0cf -- Jun 13 03:44:08.240373 ip-10-0-133-206 systemd[1]: Starting Kubernetes Kubelet... Jun 13 03:44:08.678101 ip-10-0-133-206 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 03:44:08.678101 ip-10-0-133-206 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 03:44:08.678101 ip-10-0-133-206 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 03:44:08.678101 ip-10-0-133-206 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 03:44:08.678101 ip-10-0-133-206 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 03:44:08.679195 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.679097 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 03:44:08.687215 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687196 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:08.687215 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687212 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:08.687215 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687219 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:08.687215 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687223 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687228 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687232 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687236 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687240 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687244 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687248 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687251 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687255 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687259 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687263 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687277 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687284 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687290 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687294 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687299 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687303 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687307 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687311 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:08.687471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687315 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687321 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687326 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687339 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687343 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687347 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687351 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687355 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687360 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687365 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687369 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687374 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687378 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687382 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687386 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687390 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687395 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687399 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687403 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:08.688268 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687407 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687411 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687415 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687419 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687423 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687428 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687434 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687439 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687443 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687448 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687452 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687457 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687461 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687465 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687469 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687473 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687477 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687481 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687486 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687490 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:08.689050 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687494 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687498 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687503 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687508 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687512 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687517 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687521 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687525 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687530 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687534 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687538 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687542 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687547 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687551 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687555 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687559 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687564 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687568 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687572 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687577 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:08.689883 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687581 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687586 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687592 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687596 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687603 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687609 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687614 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687620 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687625 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687629 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687634 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687638 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687642 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687647 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687651 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687656 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687660 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.687664 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688809 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:08.690739 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688819 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688824 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688828 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688832 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688837 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688844 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688850 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688855 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688860 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688865 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688869 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688874 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688878 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688883 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688887 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688892 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688896 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688901 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688906 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:08.691480 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688910 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688914 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688919 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688923 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688927 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688931 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688935 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688939 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688945 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688949 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688954 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688959 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688963 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688967 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688971 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688975 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688980 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688984 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688988 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688993 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:08.692221 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.688997 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689001 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689005 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689009 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689014 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689018 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689022 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689027 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689031 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689035 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689041 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689045 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689049 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689053 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689057 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689061 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689065 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689069 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689073 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689077 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:08.692824 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689082 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689087 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689091 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689096 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689100 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689105 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689109 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689113 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689117 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689141 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689146 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689150 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689156 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689162 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689167 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689171 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689175 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689180 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689184 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:08.693396 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689187 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689193 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689197 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689201 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689206 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689210 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689214 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689219 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689223 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689227 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689231 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689235 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689239 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689246 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689250 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689256 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689262 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689267 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689271 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689275 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:08.693854 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689838 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689846 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689851 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689856 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689860 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689864 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689869 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689873 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689877 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689881 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689885 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689889 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689893 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689898 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689902 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689906 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689911 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689915 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689919 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689923 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:08.694373 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689927 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689932 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689936 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689940 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689944 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689949 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689953 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689958 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689962 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689967 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689971 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689976 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689980 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689984 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689988 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689992 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.689996 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690000 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690004 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:08.694856 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690008 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690012 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690016 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690021 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690025 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690029 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690033 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690038 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690042 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690046 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690052 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690056 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690060 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690067 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690072 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690077 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690081 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690085 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690094 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:08.695339 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690099 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690103 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690107 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690112 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690116 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690137 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690142 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690146 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690151 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690155 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690159 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690163 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690170 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690175 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690180 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690185 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690189 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690194 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690198 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690203 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:08.695806 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690208 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690213 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690217 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690223 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690227 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690232 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690236 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690240 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690245 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690249 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690253 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690259 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690263 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690268 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690272 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690276 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690280 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690284 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690289 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690293 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:08.696315 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.690298 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690395 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690405 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690415 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690422 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690429 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690435 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690441 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690448 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690453 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690457 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690463 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690468 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690473 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690479 2574 flags.go:64] FLAG: --cgroup-root="" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690483 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690488 2574 flags.go:64] FLAG: --client-ca-file="" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690493 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690498 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690504 2574 flags.go:64] FLAG: --cluster-domain="" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690508 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690513 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690518 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690526 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 03:44:08.696799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690533 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690538 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690543 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690548 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690553 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690557 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690562 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690567 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690572 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690578 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690583 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690588 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690592 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690597 2574 flags.go:64] FLAG: --enable-server="true" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690604 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690694 2574 flags.go:64] FLAG: --event-burst="100" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690702 2574 flags.go:64] FLAG: --event-qps="50" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690707 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690713 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690719 2574 flags.go:64] FLAG: --eviction-hard="" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690725 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690731 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690736 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690760 2574 flags.go:64] FLAG: --eviction-soft="" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690765 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 03:44:08.697400 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.690771 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692368 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692438 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692445 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692451 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692459 2574 flags.go:64] FLAG: --feature-gates="" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692637 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692649 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692653 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692658 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692661 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692666 2574 flags.go:64] FLAG: --help="false" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692669 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-133-206.ec2.internal" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692673 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692676 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692679 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692683 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692688 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692691 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692694 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692697 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692700 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692703 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692706 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 03:44:08.698012 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692709 2574 flags.go:64] FLAG: --kube-reserved="" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692713 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692716 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692719 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692722 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692725 2574 flags.go:64] FLAG: --lock-file="" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692728 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692731 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692734 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692751 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692754 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692757 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692760 2574 flags.go:64] FLAG: --logging-format="text" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692763 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692768 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692771 2574 flags.go:64] FLAG: --manifest-url="" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692774 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692778 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692782 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692786 2574 flags.go:64] FLAG: --max-pods="110" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692789 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692792 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692795 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692798 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692801 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 03:44:08.698620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692804 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692807 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692816 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692819 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692822 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692826 2574 flags.go:64] FLAG: --pod-cidr="" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692829 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692834 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692838 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692841 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692844 2574 flags.go:64] FLAG: --port="10250" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692847 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692850 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eecd706a2386b7f7" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692854 2574 flags.go:64] FLAG: --qos-reserved="" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692856 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692860 2574 flags.go:64] FLAG: --register-node="true" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692863 2574 flags.go:64] FLAG: --register-with-taints="" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692866 2574 flags.go:64] FLAG: --registry-burst="10" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692869 2574 flags.go:64] FLAG: --registry-qps="5" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692872 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692875 2574 flags.go:64] FLAG: --reserved-memory="" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692880 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692883 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692886 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692889 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 03:44:08.699270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692892 2574 flags.go:64] FLAG: --runonce="false" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692895 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692898 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692901 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692904 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692907 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692910 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692914 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692917 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692920 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692924 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692926 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692929 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692932 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692935 2574 flags.go:64] FLAG: --system-cgroups="" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692938 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692944 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692947 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692950 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692955 2574 flags.go:64] FLAG: --tls-min-version="" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692958 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692961 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692963 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692966 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692969 2574 flags.go:64] FLAG: --v="2" Jun 13 03:44:08.699881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692973 2574 flags.go:64] FLAG: --version="false" Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692977 2574 flags.go:64] FLAG: --vmodule="" Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692981 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.692987 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693104 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693109 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693112 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693115 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693118 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693135 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693139 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693142 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693145 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693148 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693150 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693153 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693156 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693158 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693162 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693164 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:08.700594 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693167 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693169 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693173 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693175 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693178 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693180 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693183 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693185 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693188 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693191 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693193 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693196 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693198 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693201 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693204 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693212 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693214 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693217 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693219 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693222 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:08.701085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693226 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693229 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693231 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693234 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693236 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693239 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693241 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693244 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693247 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693249 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693252 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693254 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693257 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693259 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693262 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693264 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693267 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693269 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693272 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693275 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:08.701603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693277 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693280 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693283 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693286 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693288 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693291 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693293 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693299 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693303 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693306 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693308 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693311 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693314 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693317 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693319 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693322 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693325 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693327 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693330 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:08.702080 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693332 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693335 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693337 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693340 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693343 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693345 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693348 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693351 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693354 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693357 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693360 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693363 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693365 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693368 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693370 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693373 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693375 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693379 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693382 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:08.702646 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693385 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693390 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693392 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693395 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.693398 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.694079 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.700692 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.700710 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.700731 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.700736 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700789 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700794 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700798 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700801 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700804 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:08.703110 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700807 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700810 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700813 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700816 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700818 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700821 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700824 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700827 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700829 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700832 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700835 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700837 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700840 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700843 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700846 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700849 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700852 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700855 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700857 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:08.703511 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700860 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700862 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700865 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700868 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700870 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700873 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700876 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700879 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700881 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700884 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700886 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700889 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700892 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700895 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700897 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700900 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700902 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700905 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700908 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700910 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:08.703981 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700913 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700915 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700918 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700921 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700924 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700928 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700932 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700935 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700937 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700940 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700943 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700947 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700950 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700954 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700958 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700961 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700964 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700967 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700969 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:08.704495 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700973 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700975 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700978 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700980 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700983 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700985 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700988 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700990 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700993 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700995 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.700998 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701000 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701003 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701005 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701008 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701011 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701013 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701016 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701019 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701021 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:08.704952 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701024 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701026 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701029 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701031 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701034 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701036 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701039 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701041 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701044 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701047 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701049 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701052 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701055 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701058 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701061 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:08.705596 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701064 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.701069 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701211 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701216 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701219 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701222 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701224 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701227 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701230 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701233 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701236 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701238 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701241 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701244 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701246 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:08.705949 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701250 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701252 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701255 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701257 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701260 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701263 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701266 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701268 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701270 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701273 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701276 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701279 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701282 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701285 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701288 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701291 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701294 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701297 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701299 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:08.706341 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701302 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701304 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701307 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701310 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701312 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701315 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701318 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701321 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701323 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701326 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701328 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701331 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701333 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701336 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701340 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701343 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701347 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701349 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701352 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701355 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:08.706796 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701358 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701360 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701363 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701366 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701368 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701372 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701375 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701378 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701381 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701384 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701387 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701390 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701392 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701395 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701397 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701400 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701402 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701405 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701407 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:08.707286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701410 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701413 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701415 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701418 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701420 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701423 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701425 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701428 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701431 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701433 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701436 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701438 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701441 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701443 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701446 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701448 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701451 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701453 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701456 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701459 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:08.707758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701463 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701465 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701468 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701471 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701474 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701477 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701479 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:08.701482 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.701486 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.701589 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.703789 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.705407 2574 server.go:1019] "Starting client certificate rotation" Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.705512 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 03:44:08.708249 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.705551 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 03:44:08.710089 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.710075 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 03:44:08.714569 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.714555 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 03:44:08.724681 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.724662 2574 log.go:25] "Validated CRI v1 runtime API" Jun 13 03:44:08.727669 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.727651 2574 log.go:25] "Validated CRI v1 image API" Jun 13 03:44:08.728467 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.728454 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 03:44:08.730958 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.730939 2574 fs.go:135] Filesystem UUIDs: map[604176d2-3b28-4ee8-81cb-01a2b4c7d6aa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 efee6f76-d9ec-41a5-ba96-9ac8306ea4e6:/dev/nvme0n1p3] Jun 13 03:44:08.731017 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.730957 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 03:44:08.737335 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.737183 2574 manager.go:216] Machine: {Timestamp:2026-06-13 03:44:08.735892089 +0000 UTC m=+0.366554671 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099999 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2edc92b753619c6bcc19a22e89f36c SystemUUID:ec2edc92-b753-619c-6bcc-19a22e89f36c BootID:a1a08bb1-5d75-4d70-b819-9cefbeb5b0cf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8d:6a:2c:91:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8d:6a:2c:91:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:39:e7:c2:00:2f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 03:44:08.737335 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.737325 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 03:44:08.737571 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.737551 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 03:44:08.740963 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.740938 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 03:44:08.741098 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.740965 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-206.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 03:44:08.742169 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.742159 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 03:44:08.742208 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.742172 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 03:44:08.742208 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.742179 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 03:44:08.742894 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.742883 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 03:44:08.742927 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.742901 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 03:44:08.745302 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.745291 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 03:44:08.749096 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.749085 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 13 03:44:08.749371 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.749361 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 03:44:08.749408 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.749392 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 13 03:44:08.749408 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.749402 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 03:44:08.749460 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.749415 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 03:44:08.749460 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.749424 2574 kubelet.go:398] "Adding apiserver pod source" Jun 13 03:44:08.749460 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.749432 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 03:44:08.749783 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.749772 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 03:44:08.749826 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.749794 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 03:44:08.752113 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.752098 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 03:44:08.753586 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.753572 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 03:44:08.753660 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.753602 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 03:44:08.753757 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.753746 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 03:44:08.753798 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.753761 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 03:44:08.753798 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.753768 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 03:44:08.753798 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.753774 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 03:44:08.753798 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.753781 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 03:44:08.753798 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.753787 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 03:44:08.755953 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.755942 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 03:44:08.755953 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.755950 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 03:44:08.756073 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.755966 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 03:44:08.756073 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.755972 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 03:44:08.756073 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.755989 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 03:44:08.756073 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.755998 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 03:44:08.757061 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.757042 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7jcl" Jun 13 03:44:08.757479 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.757469 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 03:44:08.757479 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.757480 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 03:44:08.759075 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.759050 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 03:44:08.759075 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.759050 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-206.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 03:44:08.759286 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.759268 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-206.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 03:44:08.760520 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.760506 2574 server.go:1268] "Started kubelet" Jun 13 03:44:08.760641 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.760600 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 03:44:08.760732 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.760668 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 03:44:08.760732 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.760726 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 03:44:08.762358 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.762337 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 03:44:08.762762 ip-10-0-133-206 systemd[1]: Started Kubernetes Kubelet. Jun 13 03:44:08.763681 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.763668 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 13 03:44:08.764053 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.764036 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7jcl" Jun 13 03:44:08.768428 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.768371 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 03:44:08.768428 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.768424 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 03:44:08.768552 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.768503 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:08.769468 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769317 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 03:44:08.769468 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769359 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 03:44:08.769468 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769461 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 13 03:44:08.769468 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769472 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 13 03:44:08.769710 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769537 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 03:44:08.769710 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769571 2574 factory.go:55] Registering systemd factory Jun 13 03:44:08.769710 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769586 2574 factory.go:223] Registration of the systemd container factory successfully Jun 13 03:44:08.769831 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769811 2574 factory.go:153] Registering CRI-O factory Jun 13 03:44:08.769831 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769824 2574 factory.go:223] Registration of the crio container factory successfully Jun 13 03:44:08.769926 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769874 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 03:44:08.769926 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769897 2574 factory.go:103] Registering Raw factory Jun 13 03:44:08.769926 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.769912 2574 manager.go:1196] Started watching for new ooms in manager Jun 13 03:44:08.770326 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.770311 2574 manager.go:349] Starting recovery of all containers Jun 13 03:44:08.774947 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.774928 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:08.777916 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.777895 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-206.ec2.internal\" not found" node="ip-10-0-133-206.ec2.internal" Jun 13 03:44:08.779138 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.778992 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 03:44:08.785354 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.785340 2574 manager.go:354] Recovery completed Jun 13 03:44:08.788900 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.788889 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:08.790645 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.790629 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:08.790704 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.790655 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:08.790704 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.790665 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:08.791141 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.791111 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 03:44:08.791207 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.791142 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 03:44:08.791207 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.791156 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:08.791207 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.791163 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 13 03:44:08.791792 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.791779 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:08.791836 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.791801 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:08.791836 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.791810 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:08.792325 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.792313 2574 policy_none.go:49] "None policy: Start" Jun 13 03:44:08.792371 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.792329 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 03:44:08.792371 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.792339 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 03:44:08.793405 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.793395 2574 policy_none.go:47] "Start" Jun 13 03:44:08.831685 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.831669 2574 manager.go:337] "Starting Device Plugin manager" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.831701 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.831710 2574 server.go:87] "Starting device plugin registration server" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.831921 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.831931 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.832014 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.832094 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.832104 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.832539 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.832598 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.841687 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.842775 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.842806 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.842828 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.842858 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 03:44:08.847676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.845086 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:08.932994 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.932978 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:08.933785 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.933771 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:08.933862 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.933794 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:08.933862 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.933804 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:08.933862 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.933825 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-206.ec2.internal" Jun 13 03:44:08.943670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.943648 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal"] Jun 13 03:44:08.943737 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.943704 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:08.943935 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.943922 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-206.ec2.internal" Jun 13 03:44:08.943989 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.943945 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-206.ec2.internal\": node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:08.945057 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.945042 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:08.945144 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.945069 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:08.945144 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.945083 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:08.946297 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.946283 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:08.946415 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.946399 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" Jun 13 03:44:08.946464 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.946435 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:08.947521 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.947489 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:08.947521 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.947489 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:08.947521 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.947517 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:08.947668 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.947528 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:08.947668 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.947537 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:08.947668 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.947552 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:08.948615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.948602 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal" Jun 13 03:44:08.948658 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.948625 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:08.949781 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.949762 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:08.949840 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.949795 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:08.949840 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:08.949810 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:08.956229 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.956213 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:08.972647 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.972630 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-206.ec2.internal\" not found" node="ip-10-0-133-206.ec2.internal" Jun 13 03:44:08.976544 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:08.976530 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-206.ec2.internal\" not found" node="ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.056644 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.056625 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:09.070905 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.070886 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b199569db9e205b9df31600eda2c84d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal\" (UID: \"b199569db9e205b9df31600eda2c84d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.070953 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.070910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b199569db9e205b9df31600eda2c84d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal\" (UID: \"b199569db9e205b9df31600eda2c84d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.070953 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.070933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c9771c6251e91aa8a81206e3d563d1b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-206.ec2.internal\" (UID: \"0c9771c6251e91aa8a81206e3d563d1b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.157584 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.157554 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:09.171898 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.171879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b199569db9e205b9df31600eda2c84d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal\" (UID: \"b199569db9e205b9df31600eda2c84d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.171949 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.171911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b199569db9e205b9df31600eda2c84d9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal\" (UID: \"b199569db9e205b9df31600eda2c84d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.171949 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.171932 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b199569db9e205b9df31600eda2c84d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal\" (UID: \"b199569db9e205b9df31600eda2c84d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.172007 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.171947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c9771c6251e91aa8a81206e3d563d1b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-206.ec2.internal\" (UID: \"0c9771c6251e91aa8a81206e3d563d1b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.172007 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.171966 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c9771c6251e91aa8a81206e3d563d1b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-206.ec2.internal\" (UID: \"0c9771c6251e91aa8a81206e3d563d1b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.172007 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.171983 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b199569db9e205b9df31600eda2c84d9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal\" (UID: \"b199569db9e205b9df31600eda2c84d9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.258287 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.258242 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:09.274735 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.274722 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.280734 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.280717 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.358349 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.358323 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:09.458783 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.458767 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:09.559373 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.559319 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-206.ec2.internal\" not found" Jun 13 03:44:09.626334 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.626312 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:09.669556 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.669533 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.680221 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.680204 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 03:44:09.681916 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.681899 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal" Jun 13 03:44:09.691016 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.691000 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 03:44:09.705154 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.705112 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 03:44:09.705268 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.705248 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 03:44:09.705327 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.705248 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 03:44:09.705327 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.705258 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 03:44:09.744471 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.744449 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:09.749566 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.749547 2574 apiserver.go:52] "Watching apiserver" Jun 13 03:44:09.756773 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.756586 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 03:44:09.757868 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.757368 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal","openshift-multus/multus-kxddx","openshift-ovn-kubernetes/ovnkube-node-548bh","kube-system/konnectivity-agent-xmwfg","kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal","openshift-multus/multus-additional-cni-plugins-ckjmp","openshift-multus/network-metrics-daemon-tbxdr","openshift-network-diagnostics/network-check-target-8mk6x","openshift-network-operator/iptables-alerter-mqk8h","kube-system/global-pull-secret-syncer-vzccg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc","openshift-cluster-node-tuning-operator/tuned-5496l","openshift-dns/node-resolver-hprjm","openshift-image-registry/node-ca-cdtxs"] Jun 13 03:44:09.759054 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.759033 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.760109 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.760088 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.761453 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.761403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.761565 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.761403 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 03:44:09.761747 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.761730 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 03:44:09.761856 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.761820 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:44:09.761856 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.761821 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tfsgw\"" Jun 13 03:44:09.762426 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.762409 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 03:44:09.762629 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.762608 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 03:44:09.762629 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.762625 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 03:44:09.762764 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.762643 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:09.762764 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.762670 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 03:44:09.763118 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.763102 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wcgzk\"" Jun 13 03:44:09.763569 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.763551 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 03:44:09.763633 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.763582 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 03:44:09.763793 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.763765 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.763879 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.763860 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 03:44:09.763957 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.763907 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9rbs4\"" Jun 13 03:44:09.764945 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.764930 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.765091 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.765076 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rb5ht\"" Jun 13 03:44:09.765176 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.765154 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 03:44:09.765338 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.765321 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 03:44:09.766043 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.766028 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:09.766115 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.766089 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:09.766278 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.766264 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fsvks\"" Jun 13 03:44:09.766337 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.766302 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 03:44:09.766378 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.766342 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 03:44:09.767286 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.767256 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8s769\"" Jun 13 03:44:09.767379 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.767256 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 03:44:09.767439 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.767393 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:09.767439 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.767414 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 03:44:09.767515 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.767448 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:09.767549 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.767518 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 03:44:09.768594 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.768573 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 03:44:09.768710 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.768695 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:09.768786 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.768753 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:09.769339 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.769297 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 03:39:08 +0000 UTC" deadline="2028-01-11 20:32:41.807379066 +0000 UTC" Jun 13 03:44:09.769339 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.769339 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13864h48m32.038043953s" Jun 13 03:44:09.769896 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.769881 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.772095 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.772078 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 03:44:09.772095 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.772089 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hzfj4\"" Jun 13 03:44:09.772240 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.772137 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 03:44:09.774348 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.774700 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774635 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-cnibin\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.774700 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-sys\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.774700 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-etc-kubernetes\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.774891 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774721 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cb1671c-17d2-4347-a634-a77e1c7559fe-konnectivity-ca\") pod \"konnectivity-agent-xmwfg\" (UID: \"5cb1671c-17d2-4347-a634-a77e1c7559fe\") " pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:09.774891 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:09.774891 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-os-release\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.774891 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-var-lib-kubelet\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.774891 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-run\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.774891 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774882 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-var-lib-kubelet\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d873938a-d1bf-4847-a272-c8a9ef0cd6ad-host\") pod \"node-ca-cdtxs\" (UID: \"d873938a-d1bf-4847-a272-c8a9ef0cd6ad\") " pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk69j\" (UniqueName: \"kubernetes.io/projected/34437e2f-10e6-4648-919f-47114ccfa74d-kube-api-access-rk69j\") pod \"iptables-alerter-mqk8h\" (UID: \"34437e2f-10e6-4648-919f-47114ccfa74d\") " pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.774995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-system-cni-dir\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8dffa386-13e6-4d56-beda-749d7c887d84-multus-daemon-config\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-systemd\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-multus-socket-dir-parent\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-var-lib-cni-bin\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsjb9\" (UniqueName: \"kubernetes.io/projected/d873938a-d1bf-4847-a272-c8a9ef0cd6ad-kube-api-access-nsjb9\") pod \"node-ca-cdtxs\" (UID: \"d873938a-d1bf-4847-a272-c8a9ef0cd6ad\") " pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgb7k\" (UniqueName: \"kubernetes.io/projected/2e253d7f-5d81-44de-8758-b388157c2c23-kube-api-access-qgb7k\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775343 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-hostroot\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05ed7d04-f583-4e9a-8acb-74a8411da301-tmp-dir\") pod \"node-resolver-hprjm\" (UID: \"05ed7d04-f583-4e9a-8acb-74a8411da301\") " pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-device-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.775473 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d873938a-d1bf-4847-a272-c8a9ef0cd6ad-serviceca\") pod \"node-ca-cdtxs\" (UID: \"d873938a-d1bf-4847-a272-c8a9ef0cd6ad\") " pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-run-k8s-cni-cncf-io\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-run-netns\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-multus-cni-dir\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dffa386-13e6-4d56-beda-749d7c887d84-cni-binary-copy\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-sysctl-d\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-var-lib-cni-multus\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05ed7d04-f583-4e9a-8acb-74a8411da301-hosts-file\") pod \"node-resolver-hprjm\" (UID: \"05ed7d04-f583-4e9a-8acb-74a8411da301\") " pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cb1671c-17d2-4347-a634-a77e1c7559fe-agent-certs\") pod \"konnectivity-agent-xmwfg\" (UID: \"5cb1671c-17d2-4347-a634-a77e1c7559fe\") " pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-dbus\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34437e2f-10e6-4648-919f-47114ccfa74d-iptables-alerter-script\") pod \"iptables-alerter-mqk8h\" (UID: \"34437e2f-10e6-4648-919f-47114ccfa74d\") " pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-multus-conf-dir\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-modprobe-d\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn4fz\" (UniqueName: \"kubernetes.io/projected/05ed7d04-f583-4e9a-8acb-74a8411da301-kube-api-access-tn4fz\") pod \"node-resolver-hprjm\" (UID: \"05ed7d04-f583-4e9a-8acb-74a8411da301\") " pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775884 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-sysconfig\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-kubernetes\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.776150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-sysctl-conf\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-system-cni-dir\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.775984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-registration-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-cni-binary-copy\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776017 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvrgr\" (UniqueName: \"kubernetes.io/projected/b7759704-8063-4842-aaa1-b1101414e202-kube-api-access-nvrgr\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-socket-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-cnibin\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-kubelet-config\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-os-release\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-run-multus-certs\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7759704-8063-4842-aaa1-b1101414e202-etc-tuned\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7759704-8063-4842-aaa1-b1101414e202-tmp\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-etc-selinux\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34437e2f-10e6-4648-919f-47114ccfa74d-host-slash\") pod \"iptables-alerter-mqk8h\" (UID: \"34437e2f-10e6-4648-919f-47114ccfa74d\") " pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-lib-modules\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-sys-fs\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.776746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.777229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.777229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwsd4\" (UniqueName: \"kubernetes.io/projected/8dffa386-13e6-4d56-beda-749d7c887d84-kube-api-access-jwsd4\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.777229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776406 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 03:44:09.777229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776437 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:44:09.777229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xzv6\" (UniqueName: \"kubernetes.io/projected/5249c400-ac62-4edd-b111-d6529a4e672d-kube-api-access-8xzv6\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:09.777229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mr7v\" (UniqueName: \"kubernetes.io/projected/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-kube-api-access-4mr7v\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.777229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776545 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-host\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.777229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.777229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.776700 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jlb2w\"" Jun 13 03:44:09.778490 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.778178 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 03:44:09.778490 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.778379 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 03:44:09.778490 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.778385 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 03:44:09.778734 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.778547 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fd7vj\"" Jun 13 03:44:09.778824 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.778803 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 03:44:09.780424 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.779236 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 03:44:09.780424 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.779333 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 03:44:09.782792 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.782777 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 03:44:09.786071 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:09.786052 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb199569db9e205b9df31600eda2c84d9.slice/crio-c947df9f1528f119a786953b7e672fcf37792ff50c86d7f3998ce4ac8a2ed1e5 WatchSource:0}: Error finding container c947df9f1528f119a786953b7e672fcf37792ff50c86d7f3998ce4ac8a2ed1e5: Status 404 returned error can't find the container with id c947df9f1528f119a786953b7e672fcf37792ff50c86d7f3998ce4ac8a2ed1e5 Jun 13 03:44:09.788079 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:09.787979 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9771c6251e91aa8a81206e3d563d1b.slice/crio-662b4b50dab986f91ef68729b84670bf0dad6760a0a05107b7586dde94a661f6 WatchSource:0}: Error finding container 662b4b50dab986f91ef68729b84670bf0dad6760a0a05107b7586dde94a661f6: Status 404 returned error can't find the container with id 662b4b50dab986f91ef68729b84670bf0dad6760a0a05107b7586dde94a661f6 Jun 13 03:44:09.795744 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.795730 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 03:44:09.798337 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.798318 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbmqs" Jun 13 03:44:09.805255 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.805238 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbmqs" Jun 13 03:44:09.846332 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.846290 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" event={"ID":"b199569db9e205b9df31600eda2c84d9","Type":"ContainerStarted","Data":"c947df9f1528f119a786953b7e672fcf37792ff50c86d7f3998ce4ac8a2ed1e5"} Jun 13 03:44:09.847212 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.847193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal" event={"ID":"0c9771c6251e91aa8a81206e3d563d1b","Type":"ContainerStarted","Data":"662b4b50dab986f91ef68729b84670bf0dad6760a0a05107b7586dde94a661f6"} Jun 13 03:44:09.870614 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.870594 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 03:44:09.877398 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvrgr\" (UniqueName: \"kubernetes.io/projected/b7759704-8063-4842-aaa1-b1101414e202-kube-api-access-nvrgr\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.877467 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-socket-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.877467 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-cnibin\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.877467 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-systemd-units\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.877579 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-kubelet-config\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:09.877579 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877497 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-os-release\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.877579 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877500 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-cnibin\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.877579 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-kubelet-config\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:09.877579 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877548 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-socket-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-run-multus-certs\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7759704-8063-4842-aaa1-b1101414e202-etc-tuned\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7759704-8063-4842-aaa1-b1101414e202-tmp\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877626 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-os-release\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-etc-selinux\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-etc-openvswitch\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-run-multus-certs\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34437e2f-10e6-4648-919f-47114ccfa74d-host-slash\") pod \"iptables-alerter-mqk8h\" (UID: \"34437e2f-10e6-4648-919f-47114ccfa74d\") " pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-etc-selinux\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-lib-modules\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877761 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34437e2f-10e6-4648-919f-47114ccfa74d-host-slash\") pod \"iptables-alerter-mqk8h\" (UID: \"34437e2f-10e6-4648-919f-47114ccfa74d\") " pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.877815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877799 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-sys-fs\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.878311 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877890 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 03:44:09.878311 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.877895 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-lib-modules\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.878381 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878310 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.878381 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.878446 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-log-socket\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.878446 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878437 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwsd4\" (UniqueName: \"kubernetes.io/projected/8dffa386-13e6-4d56-beda-749d7c887d84-kube-api-access-jwsd4\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.878516 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878461 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xzv6\" (UniqueName: \"kubernetes.io/projected/5249c400-ac62-4edd-b111-d6529a4e672d-kube-api-access-8xzv6\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:09.878638 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mr7v\" (UniqueName: \"kubernetes.io/projected/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-kube-api-access-4mr7v\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.878682 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-host\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.878682 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.878753 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-cnibin\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.878753 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878723 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-sys\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.878753 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-etc-kubernetes\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.878854 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cb1671c-17d2-4347-a634-a77e1c7559fe-konnectivity-ca\") pod \"konnectivity-agent-xmwfg\" (UID: \"5cb1671c-17d2-4347-a634-a77e1c7559fe\") " pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:09.878854 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:09.878854 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-os-release\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.878854 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878834 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.878983 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-var-lib-kubelet\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.878983 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-run\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.878983 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-host\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.878983 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-var-lib-kubelet\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.878983 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d873938a-d1bf-4847-a272-c8a9ef0cd6ad-host\") pod \"node-ca-cdtxs\" (UID: \"d873938a-d1bf-4847-a272-c8a9ef0cd6ad\") " pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.878983 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.878948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk69j\" (UniqueName: \"kubernetes.io/projected/34437e2f-10e6-4648-919f-47114ccfa74d-kube-api-access-rk69j\") pod \"iptables-alerter-mqk8h\" (UID: \"34437e2f-10e6-4648-919f-47114ccfa74d\") " pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.879217 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-system-cni-dir\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.879217 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8dffa386-13e6-4d56-beda-749d7c887d84-multus-daemon-config\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.879217 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:09.879217 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-systemd\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.879217 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.879217 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72c23acf-2ed0-49c1-9c38-e875dc76ebda-ovn-node-metrics-cert\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72c23acf-2ed0-49c1-9c38-e875dc76ebda-ovnkube-script-lib\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879244 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-sys-fs\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879290 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-run\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-multus-socket-dir-parent\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879365 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-systemd\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.879372 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879367 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-multus-socket-dir-parent\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-var-lib-cni-bin\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsjb9\" (UniqueName: \"kubernetes.io/projected/d873938a-d1bf-4847-a272-c8a9ef0cd6ad-kube-api-access-nsjb9\") pod \"node-ca-cdtxs\" (UID: \"d873938a-d1bf-4847-a272-c8a9ef0cd6ad\") " pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879418 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-cnibin\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.879428 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret podName:5c43ac6a-27cd-4733-8c96-05f58f2bdbd8 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:10.379409497 +0000 UTC m=+2.010072083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret") pod "global-pull-secret-syncer-vzccg" (UID: "5c43ac6a-27cd-4733-8c96-05f58f2bdbd8") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-etc-kubernetes\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-system-cni-dir\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879463 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cb1671c-17d2-4347-a634-a77e1c7559fe-konnectivity-ca\") pod \"konnectivity-agent-xmwfg\" (UID: \"5cb1671c-17d2-4347-a634-a77e1c7559fe\") " pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgb7k\" (UniqueName: \"kubernetes.io/projected/2e253d7f-5d81-44de-8758-b388157c2c23-kube-api-access-qgb7k\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.879508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-os-release\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879504 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-var-lib-kubelet\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879519 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-var-lib-kubelet\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d873938a-d1bf-4847-a272-c8a9ef0cd6ad-host\") pod \"node-ca-cdtxs\" (UID: \"d873938a-d1bf-4847-a272-c8a9ef0cd6ad\") " pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879546 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-run-netns\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879374 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-sys\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-run-ovn\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-hostroot\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879648 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05ed7d04-f583-4e9a-8acb-74a8411da301-tmp-dir\") pod \"node-resolver-hprjm\" (UID: \"05ed7d04-f583-4e9a-8acb-74a8411da301\") " pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.879688 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879658 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879698 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-var-lib-cni-bin\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879728 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.879765 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs podName:5249c400-ac62-4edd-b111-d6529a4e672d nodeName:}" failed. No retries permitted until 2026-06-13 03:44:10.379734273 +0000 UTC m=+2.010396843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs") pod "network-metrics-daemon-tbxdr" (UID: "5249c400-ac62-4edd-b111-d6529a4e672d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879772 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-hostroot\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.880263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879863 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-device-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879905 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-run-openvswitch\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05ed7d04-f583-4e9a-8acb-74a8411da301-tmp-dir\") pod \"node-resolver-hprjm\" (UID: \"05ed7d04-f583-4e9a-8acb-74a8411da301\") " pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879928 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-device-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.879983 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-node-log\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72c23acf-2ed0-49c1-9c38-e875dc76ebda-env-overrides\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d873938a-d1bf-4847-a272-c8a9ef0cd6ad-serviceca\") pod \"node-ca-cdtxs\" (UID: \"d873938a-d1bf-4847-a272-c8a9ef0cd6ad\") " pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-run-k8s-cni-cncf-io\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-run-netns\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-multus-cni-dir\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dffa386-13e6-4d56-beda-749d7c887d84-cni-binary-copy\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-sysctl-d\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-cni-netd\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880157 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-run-netns\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880193 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-multus-cni-dir\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-var-lib-cni-multus\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880229 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-var-lib-cni-multus\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05ed7d04-f583-4e9a-8acb-74a8411da301-hosts-file\") pod \"node-resolver-hprjm\" (UID: \"05ed7d04-f583-4e9a-8acb-74a8411da301\") " pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.881051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8dffa386-13e6-4d56-beda-749d7c887d84-multus-daemon-config\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880212 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-host-run-k8s-cni-cncf-io\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880269 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cb1671c-17d2-4347-a634-a77e1c7559fe-agent-certs\") pod \"konnectivity-agent-xmwfg\" (UID: \"5cb1671c-17d2-4347-a634-a77e1c7559fe\") " pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880287 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-sysctl-d\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-dbus\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-cni-bin\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880352 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05ed7d04-f583-4e9a-8acb-74a8411da301-hosts-file\") pod \"node-resolver-hprjm\" (UID: \"05ed7d04-f583-4e9a-8acb-74a8411da301\") " pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34437e2f-10e6-4648-919f-47114ccfa74d-iptables-alerter-script\") pod \"iptables-alerter-mqk8h\" (UID: \"34437e2f-10e6-4648-919f-47114ccfa74d\") " pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880382 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-dbus\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-multus-conf-dir\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-modprobe-d\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880420 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d873938a-d1bf-4847-a272-c8a9ef0cd6ad-serviceca\") pod \"node-ca-cdtxs\" (UID: \"d873938a-d1bf-4847-a272-c8a9ef0cd6ad\") " pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-kubelet\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-run-systemd\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880491 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dffa386-13e6-4d56-beda-749d7c887d84-multus-conf-dir\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-var-lib-openvswitch\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt2nm\" (UniqueName: \"kubernetes.io/projected/72c23acf-2ed0-49c1-9c38-e875dc76ebda-kube-api-access-jt2nm\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.881923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880572 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-modprobe-d\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn4fz\" (UniqueName: \"kubernetes.io/projected/05ed7d04-f583-4e9a-8acb-74a8411da301-kube-api-access-tn4fz\") pod \"node-resolver-hprjm\" (UID: \"05ed7d04-f583-4e9a-8acb-74a8411da301\") " pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-sysconfig\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-kubernetes\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-sysctl-conf\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-system-cni-dir\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-registration-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880728 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dffa386-13e6-4d56-beda-749d7c887d84-cni-binary-copy\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-cni-binary-copy\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-slash\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-run-ovn-kubernetes\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72c23acf-2ed0-49c1-9c38-e875dc76ebda-ovnkube-config\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880843 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34437e2f-10e6-4648-919f-47114ccfa74d-iptables-alerter-script\") pod \"iptables-alerter-mqk8h\" (UID: \"34437e2f-10e6-4648-919f-47114ccfa74d\") " pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-sysctl-conf\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880902 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-system-cni-dir\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880909 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e253d7f-5d81-44de-8758-b388157c2c23-registration-dir\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880942 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-sysconfig\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.882670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.880955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7759704-8063-4842-aaa1-b1101414e202-etc-kubernetes\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.883149 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.881232 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7759704-8063-4842-aaa1-b1101414e202-tmp\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.883149 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.881263 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-cni-binary-copy\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.883149 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.881357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7759704-8063-4842-aaa1-b1101414e202-etc-tuned\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.883149 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.882870 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cb1671c-17d2-4347-a634-a77e1c7559fe-agent-certs\") pod \"konnectivity-agent-xmwfg\" (UID: \"5cb1671c-17d2-4347-a634-a77e1c7559fe\") " pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:09.885235 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.885214 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvrgr\" (UniqueName: \"kubernetes.io/projected/b7759704-8063-4842-aaa1-b1101414e202-kube-api-access-nvrgr\") pod \"tuned-5496l\" (UID: \"b7759704-8063-4842-aaa1-b1101414e202\") " pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:09.885800 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.885784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwsd4\" (UniqueName: \"kubernetes.io/projected/8dffa386-13e6-4d56-beda-749d7c887d84-kube-api-access-jwsd4\") pod \"multus-kxddx\" (UID: \"8dffa386-13e6-4d56-beda-749d7c887d84\") " pod="openshift-multus/multus-kxddx" Jun 13 03:44:09.886365 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.886347 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mr7v\" (UniqueName: \"kubernetes.io/projected/ff2c56e2-c0e4-4c1b-8668-cac0a19a7919-kube-api-access-4mr7v\") pod \"multus-additional-cni-plugins-ckjmp\" (UID: \"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919\") " pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:09.886564 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.886547 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk69j\" (UniqueName: \"kubernetes.io/projected/34437e2f-10e6-4648-919f-47114ccfa74d-kube-api-access-rk69j\") pod \"iptables-alerter-mqk8h\" (UID: \"34437e2f-10e6-4648-919f-47114ccfa74d\") " pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:09.889508 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.889469 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:09.889508 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.889509 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:09.889656 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.889524 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmdlw for pod openshift-network-diagnostics/network-check-target-8mk6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:09.889656 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:09.889587 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw podName:c0c7484b-0184-4a95-9619-71bf929fdd1e nodeName:}" failed. No retries permitted until 2026-06-13 03:44:10.389569547 +0000 UTC m=+2.020232134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xmdlw" (UniqueName: "kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw") pod "network-check-target-8mk6x" (UID: "c0c7484b-0184-4a95-9619-71bf929fdd1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:09.889656 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.889593 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xzv6\" (UniqueName: \"kubernetes.io/projected/5249c400-ac62-4edd-b111-d6529a4e672d-kube-api-access-8xzv6\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:09.891309 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.890429 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsjb9\" (UniqueName: \"kubernetes.io/projected/d873938a-d1bf-4847-a272-c8a9ef0cd6ad-kube-api-access-nsjb9\") pod \"node-ca-cdtxs\" (UID: \"d873938a-d1bf-4847-a272-c8a9ef0cd6ad\") " pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:09.891990 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.891967 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgb7k\" (UniqueName: \"kubernetes.io/projected/2e253d7f-5d81-44de-8758-b388157c2c23-kube-api-access-qgb7k\") pod \"aws-ebs-csi-driver-node-46rhc\" (UID: \"2e253d7f-5d81-44de-8758-b388157c2c23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:09.892091 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.892067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn4fz\" (UniqueName: \"kubernetes.io/projected/05ed7d04-f583-4e9a-8acb-74a8411da301-kube-api-access-tn4fz\") pod \"node-resolver-hprjm\" (UID: \"05ed7d04-f583-4e9a-8acb-74a8411da301\") " pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:09.981295 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981295 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72c23acf-2ed0-49c1-9c38-e875dc76ebda-ovn-node-metrics-cert\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981458 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72c23acf-2ed0-49c1-9c38-e875dc76ebda-ovnkube-script-lib\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981458 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981325 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-run-netns\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981458 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-run-ovn\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981458 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981371 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-run-netns\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981458 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981388 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981458 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981444 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-run-openvswitch\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-node-log\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981474 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-run-ovn\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981479 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-run-openvswitch\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72c23acf-2ed0-49c1-9c38-e875dc76ebda-env-overrides\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-cni-netd\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981523 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-cni-bin\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-kubelet\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-run-systemd\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981506 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-node-log\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-cni-netd\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-cni-bin\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-var-lib-openvswitch\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981622 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-kubelet\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-var-lib-openvswitch\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981646 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-run-systemd\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt2nm\" (UniqueName: \"kubernetes.io/projected/72c23acf-2ed0-49c1-9c38-e875dc76ebda-kube-api-access-jt2nm\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-slash\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.981718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981697 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-run-ovn-kubernetes\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-run-ovn-kubernetes\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981743 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-host-slash\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72c23acf-2ed0-49c1-9c38-e875dc76ebda-ovnkube-config\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-systemd-units\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-etc-openvswitch\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-log-socket\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-systemd-units\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981931 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72c23acf-2ed0-49c1-9c38-e875dc76ebda-env-overrides\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-log-socket\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c23acf-2ed0-49c1-9c38-e875dc76ebda-etc-openvswitch\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.981994 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72c23acf-2ed0-49c1-9c38-e875dc76ebda-ovnkube-script-lib\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.982721 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.982245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72c23acf-2ed0-49c1-9c38-e875dc76ebda-ovnkube-config\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.983411 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.983395 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72c23acf-2ed0-49c1-9c38-e875dc76ebda-ovn-node-metrics-cert\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:09.988856 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:09.988837 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt2nm\" (UniqueName: \"kubernetes.io/projected/72c23acf-2ed0-49c1-9c38-e875dc76ebda-kube-api-access-jt2nm\") pod \"ovnkube-node-548bh\" (UID: \"72c23acf-2ed0-49c1-9c38-e875dc76ebda\") " pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:10.088866 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.088821 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqk8h" Jun 13 03:44:10.095600 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.095573 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kxddx" Jun 13 03:44:10.096698 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:10.096680 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34437e2f_10e6_4648_919f_47114ccfa74d.slice/crio-f317f36692c0eac73f8a9bb485b26cd9f35c99d0be80af3652f4f31179829e29 WatchSource:0}: Error finding container f317f36692c0eac73f8a9bb485b26cd9f35c99d0be80af3652f4f31179829e29: Status 404 returned error can't find the container with id f317f36692c0eac73f8a9bb485b26cd9f35c99d0be80af3652f4f31179829e29 Jun 13 03:44:10.100751 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.100733 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdtxs" Jun 13 03:44:10.102071 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:10.102053 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dffa386_13e6_4d56_beda_749d7c887d84.slice/crio-3f2e6af734fb12298aaff80b177d7c69e79b965e82a572221007b5a70af8fe89 WatchSource:0}: Error finding container 3f2e6af734fb12298aaff80b177d7c69e79b965e82a572221007b5a70af8fe89: Status 404 returned error can't find the container with id 3f2e6af734fb12298aaff80b177d7c69e79b965e82a572221007b5a70af8fe89 Jun 13 03:44:10.107706 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:10.107685 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd873938a_d1bf_4847_a272_c8a9ef0cd6ad.slice/crio-1d9f0a36170a80ad2315b80490bc88dd1549cdda6fb81ae377271fb2203cb80f WatchSource:0}: Error finding container 1d9f0a36170a80ad2315b80490bc88dd1549cdda6fb81ae377271fb2203cb80f: Status 404 returned error can't find the container with id 1d9f0a36170a80ad2315b80490bc88dd1549cdda6fb81ae377271fb2203cb80f Jun 13 03:44:10.110493 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.110431 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:10.115016 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.115000 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hprjm" Jun 13 03:44:10.118286 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:10.118269 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb1671c_17d2_4347_a634_a77e1c7559fe.slice/crio-fafd3cb338c58b3b1fb96af5bec9d680341a45814fcaed9670eefc734befcb9b WatchSource:0}: Error finding container fafd3cb338c58b3b1fb96af5bec9d680341a45814fcaed9670eefc734befcb9b: Status 404 returned error can't find the container with id fafd3cb338c58b3b1fb96af5bec9d680341a45814fcaed9670eefc734befcb9b Jun 13 03:44:10.120620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.120600 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" Jun 13 03:44:10.123841 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:10.123819 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ed7d04_f583_4e9a_8acb_74a8411da301.slice/crio-83d83331787d24c427d630db48c6bbaf837d43bf40bfa1a075d10a3bf4e0248c WatchSource:0}: Error finding container 83d83331787d24c427d630db48c6bbaf837d43bf40bfa1a075d10a3bf4e0248c: Status 404 returned error can't find the container with id 83d83331787d24c427d630db48c6bbaf837d43bf40bfa1a075d10a3bf4e0248c Jun 13 03:44:10.126011 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.125976 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" Jun 13 03:44:10.127945 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:10.127926 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e253d7f_5d81_44de_8758_b388157c2c23.slice/crio-b23ef93cc6f4a73fe7030332ff513decde5d7ee353ca097f3ca41aef84357b45 WatchSource:0}: Error finding container b23ef93cc6f4a73fe7030332ff513decde5d7ee353ca097f3ca41aef84357b45: Status 404 returned error can't find the container with id b23ef93cc6f4a73fe7030332ff513decde5d7ee353ca097f3ca41aef84357b45 Jun 13 03:44:10.131890 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.131870 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5496l" Jun 13 03:44:10.133006 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:10.132988 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2c56e2_c0e4_4c1b_8668_cac0a19a7919.slice/crio-9e0510fde35542db9f0cc7afd540d256df76464af50c9e13c68ef671d0611234 WatchSource:0}: Error finding container 9e0510fde35542db9f0cc7afd540d256df76464af50c9e13c68ef671d0611234: Status 404 returned error can't find the container with id 9e0510fde35542db9f0cc7afd540d256df76464af50c9e13c68ef671d0611234 Jun 13 03:44:10.136007 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.135986 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:10.138902 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:10.138875 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7759704_8063_4842_aaa1_b1101414e202.slice/crio-b05fc852970a47594535bfa6320b7fa834ae36bda2d3b129f8c3a31db740cfb1 WatchSource:0}: Error finding container b05fc852970a47594535bfa6320b7fa834ae36bda2d3b129f8c3a31db740cfb1: Status 404 returned error can't find the container with id b05fc852970a47594535bfa6320b7fa834ae36bda2d3b129f8c3a31db740cfb1 Jun 13 03:44:10.144963 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:10.144935 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c23acf_2ed0_49c1_9c38_e875dc76ebda.slice/crio-71c2ef295de7e4287fa12cfcd0862305c7f5b2fb255c9d3a3a351de57a147b4a WatchSource:0}: Error finding container 71c2ef295de7e4287fa12cfcd0862305c7f5b2fb255c9d3a3a351de57a147b4a: Status 404 returned error can't find the container with id 71c2ef295de7e4287fa12cfcd0862305c7f5b2fb255c9d3a3a351de57a147b4a Jun 13 03:44:10.384753 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.384676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:10.384902 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.384797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:10.384902 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:10.384807 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:10.384902 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:10.384877 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs podName:5249c400-ac62-4edd-b111-d6529a4e672d nodeName:}" failed. No retries permitted until 2026-06-13 03:44:11.384857812 +0000 UTC m=+3.015520386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs") pod "network-metrics-daemon-tbxdr" (UID: "5249c400-ac62-4edd-b111-d6529a4e672d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:10.385069 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:10.384914 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:10.385069 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:10.384963 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret podName:5c43ac6a-27cd-4733-8c96-05f58f2bdbd8 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:11.384948179 +0000 UTC m=+3.015610751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret") pod "global-pull-secret-syncer-vzccg" (UID: "5c43ac6a-27cd-4733-8c96-05f58f2bdbd8") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:10.485339 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.485264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:10.485511 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:10.485435 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:10.485511 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:10.485459 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:10.485511 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:10.485472 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmdlw for pod openshift-network-diagnostics/network-check-target-8mk6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:10.485660 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:10.485523 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw podName:c0c7484b-0184-4a95-9619-71bf929fdd1e nodeName:}" failed. No retries permitted until 2026-06-13 03:44:11.485505465 +0000 UTC m=+3.116168046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmdlw" (UniqueName: "kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw") pod "network-check-target-8mk6x" (UID: "c0c7484b-0184-4a95-9619-71bf929fdd1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:10.670718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.670624 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:10.808035 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.807998 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 03:39:09 +0000 UTC" deadline="2027-11-27 00:12:47.527185746 +0000 UTC" Jun 13 03:44:10.808035 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.808032 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12764h28m36.719158662s" Jun 13 03:44:10.810791 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.810770 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:10.845676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.845238 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:10.845676 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:10.845370 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:10.863445 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.863386 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" event={"ID":"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919","Type":"ContainerStarted","Data":"9e0510fde35542db9f0cc7afd540d256df76464af50c9e13c68ef671d0611234"} Jun 13 03:44:10.885204 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.885173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" event={"ID":"2e253d7f-5d81-44de-8758-b388157c2c23","Type":"ContainerStarted","Data":"b23ef93cc6f4a73fe7030332ff513decde5d7ee353ca097f3ca41aef84357b45"} Jun 13 03:44:10.916050 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.916015 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hprjm" event={"ID":"05ed7d04-f583-4e9a-8acb-74a8411da301","Type":"ContainerStarted","Data":"83d83331787d24c427d630db48c6bbaf837d43bf40bfa1a075d10a3bf4e0248c"} Jun 13 03:44:10.920843 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.920754 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kxddx" event={"ID":"8dffa386-13e6-4d56-beda-749d7c887d84","Type":"ContainerStarted","Data":"3f2e6af734fb12298aaff80b177d7c69e79b965e82a572221007b5a70af8fe89"} Jun 13 03:44:10.941559 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.941531 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqk8h" event={"ID":"34437e2f-10e6-4648-919f-47114ccfa74d","Type":"ContainerStarted","Data":"f317f36692c0eac73f8a9bb485b26cd9f35c99d0be80af3652f4f31179829e29"} Jun 13 03:44:10.958809 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.958773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" event={"ID":"72c23acf-2ed0-49c1-9c38-e875dc76ebda","Type":"ContainerStarted","Data":"71c2ef295de7e4287fa12cfcd0862305c7f5b2fb255c9d3a3a351de57a147b4a"} Jun 13 03:44:10.968581 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.968505 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5496l" event={"ID":"b7759704-8063-4842-aaa1-b1101414e202","Type":"ContainerStarted","Data":"b05fc852970a47594535bfa6320b7fa834ae36bda2d3b129f8c3a31db740cfb1"} Jun 13 03:44:10.980950 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.980919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xmwfg" event={"ID":"5cb1671c-17d2-4347-a634-a77e1c7559fe","Type":"ContainerStarted","Data":"fafd3cb338c58b3b1fb96af5bec9d680341a45814fcaed9670eefc734befcb9b"} Jun 13 03:44:10.985708 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:10.985639 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdtxs" event={"ID":"d873938a-d1bf-4847-a272-c8a9ef0cd6ad","Type":"ContainerStarted","Data":"1d9f0a36170a80ad2315b80490bc88dd1549cdda6fb81ae377271fb2203cb80f"} Jun 13 03:44:11.392523 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:11.392474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:11.392715 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:11.392542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:11.392715 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.392703 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:11.392858 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.392765 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs podName:5249c400-ac62-4edd-b111-d6529a4e672d nodeName:}" failed. No retries permitted until 2026-06-13 03:44:13.392744712 +0000 UTC m=+5.023407298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs") pod "network-metrics-daemon-tbxdr" (UID: "5249c400-ac62-4edd-b111-d6529a4e672d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:11.393208 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.393188 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:11.393320 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.393245 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret podName:5c43ac6a-27cd-4733-8c96-05f58f2bdbd8 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:13.393229662 +0000 UTC m=+5.023892231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret") pod "global-pull-secret-syncer-vzccg" (UID: "5c43ac6a-27cd-4733-8c96-05f58f2bdbd8") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:11.493621 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:11.493503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:11.493790 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.493647 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:11.493790 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.493667 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:11.493790 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.493677 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmdlw for pod openshift-network-diagnostics/network-check-target-8mk6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:11.493790 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.493731 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw podName:c0c7484b-0184-4a95-9619-71bf929fdd1e nodeName:}" failed. No retries permitted until 2026-06-13 03:44:13.493713346 +0000 UTC m=+5.124375930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmdlw" (UniqueName: "kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw") pod "network-check-target-8mk6x" (UID: "c0c7484b-0184-4a95-9619-71bf929fdd1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:11.808417 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:11.808332 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 03:39:09 +0000 UTC" deadline="2028-01-23 04:42:00.160164427 +0000 UTC" Jun 13 03:44:11.808417 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:11.808407 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14136h57m48.351760663s" Jun 13 03:44:11.844431 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:11.843777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:11.844431 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.843896 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:11.844431 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:11.844304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:11.844431 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:11.844395 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:12.104966 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:12.104582 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:12.849107 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:12.849077 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:12.849750 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:12.849228 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:13.414800 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:13.414761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:13.414987 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:13.414821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:13.414987 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.414940 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:13.414987 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.414942 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:13.415164 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.414996 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs podName:5249c400-ac62-4edd-b111-d6529a4e672d nodeName:}" failed. No retries permitted until 2026-06-13 03:44:17.414979396 +0000 UTC m=+9.045641969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs") pod "network-metrics-daemon-tbxdr" (UID: "5249c400-ac62-4edd-b111-d6529a4e672d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:13.415164 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.415013 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret podName:5c43ac6a-27cd-4733-8c96-05f58f2bdbd8 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:17.415003973 +0000 UTC m=+9.045666546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret") pod "global-pull-secret-syncer-vzccg" (UID: "5c43ac6a-27cd-4733-8c96-05f58f2bdbd8") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:13.515658 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:13.515624 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:13.515837 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.515813 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:13.515896 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.515839 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:13.515896 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.515853 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmdlw for pod openshift-network-diagnostics/network-check-target-8mk6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:13.515980 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.515911 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw podName:c0c7484b-0184-4a95-9619-71bf929fdd1e nodeName:}" failed. No retries permitted until 2026-06-13 03:44:17.515893897 +0000 UTC m=+9.146556466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmdlw" (UniqueName: "kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw") pod "network-check-target-8mk6x" (UID: "c0c7484b-0184-4a95-9619-71bf929fdd1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:13.843729 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:13.843692 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:13.843901 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.843828 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:13.844091 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:13.844070 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:13.844206 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:13.844184 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:14.843517 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:14.843092 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:14.843517 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:14.843250 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:15.844610 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:15.844076 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:15.844610 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:15.844238 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:15.844610 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:15.844315 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:15.844610 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:15.844393 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:16.844285 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:16.843640 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:16.844285 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:16.844009 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:17.446619 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:17.446335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:17.446619 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:17.446390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:17.446619 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.446500 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:17.446619 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.446560 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:17.446619 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.446573 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret podName:5c43ac6a-27cd-4733-8c96-05f58f2bdbd8 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:25.446553676 +0000 UTC m=+17.077216257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret") pod "global-pull-secret-syncer-vzccg" (UID: "5c43ac6a-27cd-4733-8c96-05f58f2bdbd8") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:17.446619 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.446594 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs podName:5249c400-ac62-4edd-b111-d6529a4e672d nodeName:}" failed. No retries permitted until 2026-06-13 03:44:25.446583848 +0000 UTC m=+17.077246415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs") pod "network-metrics-daemon-tbxdr" (UID: "5249c400-ac62-4edd-b111-d6529a4e672d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:17.547099 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:17.547061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:17.547400 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.547363 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:17.547400 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.547390 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:17.547400 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.547402 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmdlw for pod openshift-network-diagnostics/network-check-target-8mk6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:17.547634 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.547466 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw podName:c0c7484b-0184-4a95-9619-71bf929fdd1e nodeName:}" failed. No retries permitted until 2026-06-13 03:44:25.547448087 +0000 UTC m=+17.178110654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmdlw" (UniqueName: "kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw") pod "network-check-target-8mk6x" (UID: "c0c7484b-0184-4a95-9619-71bf929fdd1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:17.843511 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:17.843353 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:17.843511 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:17.843368 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:17.843511 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.843489 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:17.843925 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:17.843900 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:18.844351 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:18.844323 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:18.844811 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:18.844450 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:19.843958 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:19.843926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:19.843958 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:19.843953 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:19.844203 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:19.844052 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:19.844414 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:19.844381 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:20.843762 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:20.843729 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:20.843916 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:20.843851 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:21.843316 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:21.843285 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:21.843611 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:21.843382 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:21.843611 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:21.843435 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:21.843611 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:21.843515 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:22.843693 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:22.843660 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:22.844156 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:22.843797 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:23.843950 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:23.843892 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:23.844427 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:23.844013 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:23.844427 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:23.844078 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:23.844427 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:23.844204 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:24.843782 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:24.843749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:24.843954 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:24.843895 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:25.513618 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:25.513578 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:25.514158 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:25.513631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:25.514158 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.513723 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:25.514158 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.513735 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:25.514158 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.513790 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs podName:5249c400-ac62-4edd-b111-d6529a4e672d nodeName:}" failed. No retries permitted until 2026-06-13 03:44:41.513771474 +0000 UTC m=+33.144434042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs") pod "network-metrics-daemon-tbxdr" (UID: "5249c400-ac62-4edd-b111-d6529a4e672d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:25.514158 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.513807 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret podName:5c43ac6a-27cd-4733-8c96-05f58f2bdbd8 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:41.513799011 +0000 UTC m=+33.144461592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret") pod "global-pull-secret-syncer-vzccg" (UID: "5c43ac6a-27cd-4733-8c96-05f58f2bdbd8") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:25.614366 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:25.614336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:25.614535 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.614503 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:25.614535 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.614526 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:25.614535 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.614536 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmdlw for pod openshift-network-diagnostics/network-check-target-8mk6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:25.614675 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.614584 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw podName:c0c7484b-0184-4a95-9619-71bf929fdd1e nodeName:}" failed. No retries permitted until 2026-06-13 03:44:41.614566741 +0000 UTC m=+33.245229323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmdlw" (UniqueName: "kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw") pod "network-check-target-8mk6x" (UID: "c0c7484b-0184-4a95-9619-71bf929fdd1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:25.843706 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:25.843633 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:25.843706 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:25.843672 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:25.843891 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.843740 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:25.843891 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:25.843862 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:26.843746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:26.843714 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:26.844159 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:26.843855 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:27.843632 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:27.843599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:27.843802 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:27.843599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:27.843802 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:27.843701 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:27.843802 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:27.843777 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:28.844053 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:28.844021 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:28.844524 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:28.844160 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:29.843285 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:29.843256 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:29.843433 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:29.843262 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:29.843433 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:29.843359 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:29.843505 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:29.843427 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:30.844015 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:30.843747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:30.844570 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:30.844103 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:31.032953 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.032925 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdtxs" event={"ID":"d873938a-d1bf-4847-a272-c8a9ef0cd6ad","Type":"ContainerStarted","Data":"8b4efb326ea48bea70e3b0836e449751067ed7f2970f4e915d29c0dd92fd0a4d"} Jun 13 03:44:31.034406 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.034381 2574 generic.go:356] "Generic (PLEG): container finished" podID="b199569db9e205b9df31600eda2c84d9" containerID="cd7de2d3c66cad501a6cd162c56fe95502dffc23b553c64ef3277f589228f257" exitCode=0 Jun 13 03:44:31.034519 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.034463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" event={"ID":"b199569db9e205b9df31600eda2c84d9","Type":"ContainerDied","Data":"cd7de2d3c66cad501a6cd162c56fe95502dffc23b553c64ef3277f589228f257"} Jun 13 03:44:31.039028 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.038994 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal" event={"ID":"0c9771c6251e91aa8a81206e3d563d1b","Type":"ContainerStarted","Data":"5fa0d91cd51a58ca3e9ef4b11ec5bdd56aa108f0457d06f697888403ec6ebd0b"} Jun 13 03:44:31.040786 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.040761 2574 generic.go:356] "Generic (PLEG): container finished" podID="ff2c56e2-c0e4-4c1b-8668-cac0a19a7919" containerID="7a963c51d6d07b01e77dca02729d9e2181de10f53c73ec62886f1fb482770d54" exitCode=0 Jun 13 03:44:31.040916 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.040837 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" event={"ID":"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919","Type":"ContainerDied","Data":"7a963c51d6d07b01e77dca02729d9e2181de10f53c73ec62886f1fb482770d54"} Jun 13 03:44:31.042544 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.042526 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" event={"ID":"2e253d7f-5d81-44de-8758-b388157c2c23","Type":"ContainerStarted","Data":"8c025590ee401412051b2d6a2ec3608fc8bb4a622491e2852e233c5e47b25df5"} Jun 13 03:44:31.043907 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.043878 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hprjm" event={"ID":"05ed7d04-f583-4e9a-8acb-74a8411da301","Type":"ContainerStarted","Data":"dcdba3b9985adf527b914871727b72630a9f351887e70fe0040ffe33520d4ad5"} Jun 13 03:44:31.045489 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.045466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kxddx" event={"ID":"8dffa386-13e6-4d56-beda-749d7c887d84","Type":"ContainerStarted","Data":"9717d0c9625e53ca1e87ac5ca1f282c6947548fe66b534594dcb963b271dce38"} Jun 13 03:44:31.048067 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.048022 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cdtxs" podStartSLOduration=2.992382709 podStartE2EDuration="23.048008875s" totalImagesPullingTime="20.055626166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:31.047727444 +0000 UTC m=+22.678390054" watchObservedRunningTime="2026-06-13 03:44:31.048008875 +0000 UTC m=+22.678671465" Jun 13 03:44:31.048438 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.048416 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" event={"ID":"72c23acf-2ed0-49c1-9c38-e875dc76ebda","Type":"ContainerStarted","Data":"55d92d69dcf2e3ccd6353bd0626a56fdc20e843ec51eedca946fc6cd4282e210"} Jun 13 03:44:31.048529 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.048484 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" event={"ID":"72c23acf-2ed0-49c1-9c38-e875dc76ebda","Type":"ContainerStarted","Data":"85b3e07b44c3b0867e85f84e0ca8544090aba3ac3dd371a48da1f68f4ffc6af7"} Jun 13 03:44:31.048584 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.048532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" event={"ID":"72c23acf-2ed0-49c1-9c38-e875dc76ebda","Type":"ContainerStarted","Data":"56afc26384d081ba408cc146dd9b1af5125d46978cdb1c68d3046d0c995779bc"} Jun 13 03:44:31.048644 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.048582 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" event={"ID":"72c23acf-2ed0-49c1-9c38-e875dc76ebda","Type":"ContainerStarted","Data":"57719e4c94227eea8837aa8f7a32f33da803f5f18a9672a406e55a0de8886859"} Jun 13 03:44:31.048644 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.048631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" event={"ID":"72c23acf-2ed0-49c1-9c38-e875dc76ebda","Type":"ContainerStarted","Data":"3c7ef81982236f818a13634b047527d0bbda96b9a3d3f60917d902d69967e736"} Jun 13 03:44:31.048756 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.048664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" event={"ID":"72c23acf-2ed0-49c1-9c38-e875dc76ebda","Type":"ContainerStarted","Data":"82b645f023e44eaea6d326093141e9d3e9c4c4105836602647322b8afe3f4690"} Jun 13 03:44:31.049776 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.049747 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5496l" event={"ID":"b7759704-8063-4842-aaa1-b1101414e202","Type":"ContainerStarted","Data":"d229123511c6d3e0786c9ea0d5ba034289c69e32369cf4e03759fe9a5a01f681"} Jun 13 03:44:31.051141 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.051103 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xmwfg" event={"ID":"5cb1671c-17d2-4347-a634-a77e1c7559fe","Type":"ContainerStarted","Data":"04ed83fe577a0600ee6f34161de114dbeb8d36e7ef07f9e9d8f08aef20bce416"} Jun 13 03:44:31.061139 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.061089 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-206.ec2.internal" podStartSLOduration=22.061073658 podStartE2EDuration="22.061073658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:31.060361965 +0000 UTC m=+22.691024554" watchObservedRunningTime="2026-06-13 03:44:31.061073658 +0000 UTC m=+22.691736248" Jun 13 03:44:31.074064 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.074033 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hprjm" podStartSLOduration=3.002240181 podStartE2EDuration="23.074022151s" totalImagesPullingTime="20.07178197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:31.073655644 +0000 UTC m=+22.704318234" watchObservedRunningTime="2026-06-13 03:44:31.074022151 +0000 UTC m=+22.704684741" Jun 13 03:44:31.122235 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.122195 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kxddx" podStartSLOduration=2.991002207 podStartE2EDuration="23.122114841s" totalImagesPullingTime="20.131112634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:31.121720848 +0000 UTC m=+22.752383438" watchObservedRunningTime="2026-06-13 03:44:31.122114841 +0000 UTC m=+22.752777431" Jun 13 03:44:31.135281 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.135244 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xmwfg" podStartSLOduration=3.092507946 podStartE2EDuration="23.135230771s" totalImagesPullingTime="20.042722825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:31.134936041 +0000 UTC m=+22.765598629" watchObservedRunningTime="2026-06-13 03:44:31.135230771 +0000 UTC m=+22.765893361" Jun 13 03:44:31.151076 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.151042 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5496l" podStartSLOduration=2.093751046 podStartE2EDuration="22.151029594s" totalImagesPullingTime="20.057278548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:31.150715034 +0000 UTC m=+22.781377614" watchObservedRunningTime="2026-06-13 03:44:31.151029594 +0000 UTC m=+22.781692182" Jun 13 03:44:31.382746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.382717 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:31.383244 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.383226 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:31.650506 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.650482 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:31.650985 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.650965 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xmwfg" Jun 13 03:44:31.843175 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.843151 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:31.843377 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:31.843181 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:31.843377 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:31.843271 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:31.843500 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:31.843386 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:32.055084 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:32.055052 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" event={"ID":"b199569db9e205b9df31600eda2c84d9","Type":"ContainerStarted","Data":"fd0eb0f79a33519afb2cc13679eef73cc9d91604fbbeb487af79e39b33e6c3f8"} Jun 13 03:44:32.056700 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:32.056605 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqk8h" event={"ID":"34437e2f-10e6-4648-919f-47114ccfa74d","Type":"ContainerStarted","Data":"af77a6fba232beed22741da3fdd86e9bbaae73d8ad81912fb7d8007bd89dc627"} Jun 13 03:44:32.071726 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:32.070387 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-206.ec2.internal" podStartSLOduration=23.070362915 podStartE2EDuration="23.070362915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:32.068808763 +0000 UTC m=+23.699471352" watchObservedRunningTime="2026-06-13 03:44:32.070362915 +0000 UTC m=+23.701025506" Jun 13 03:44:32.083366 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:32.083300 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mqk8h" podStartSLOduration=3.982421865 podStartE2EDuration="24.083283261s" totalImagesPullingTime="20.100861396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:32.082790946 +0000 UTC m=+23.713453562" watchObservedRunningTime="2026-06-13 03:44:32.083283261 +0000 UTC m=+23.713945852" Jun 13 03:44:32.151642 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:32.151620 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 03:44:32.843372 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:32.843331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:32.843643 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:32.843482 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:32.845676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:32.845576 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T03:44:32.151637428Z","UUID":"e92eb837-436e-4464-8518-443ed919c0b4","Handler":null,"Name":"","Endpoint":""} Jun 13 03:44:32.847472 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:32.847449 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 03:44:32.847589 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:32.847492 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 03:44:33.061882 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:33.061817 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" event={"ID":"2e253d7f-5d81-44de-8758-b388157c2c23","Type":"ContainerStarted","Data":"7d267fd76b37cf25eb499e6c0f9695aa34300e6d46b4512711f2e2835aa5a83f"} Jun 13 03:44:33.843038 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:33.843007 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:33.843222 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:33.843109 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:33.843222 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:33.843177 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:33.843363 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:33.843278 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:34.066308 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:34.066270 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" event={"ID":"2e253d7f-5d81-44de-8758-b388157c2c23","Type":"ContainerStarted","Data":"f14c535620faa790ea4f1c318beb9427cb70fc914fc0a282742ef2c99a03ed1a"} Jun 13 03:44:34.070393 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:34.070363 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" event={"ID":"72c23acf-2ed0-49c1-9c38-e875dc76ebda","Type":"ContainerStarted","Data":"fd40f0350d98fe6eac756a8a6b6684ca538a3f81c8bc66ff5359a79c1c4da93b"} Jun 13 03:44:34.083478 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:34.083435 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46rhc" podStartSLOduration=3.5209055400000002 podStartE2EDuration="26.083422228s" totalImagesPullingTime="22.562516688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:34.082144761 +0000 UTC m=+25.712807347" watchObservedRunningTime="2026-06-13 03:44:34.083422228 +0000 UTC m=+25.714084817" Jun 13 03:44:34.843423 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:34.843206 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:34.843651 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:34.843540 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:35.843307 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:35.843280 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:35.844138 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:35.843286 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:35.844138 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:35.843395 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:35.844138 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:35.843471 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:36.076212 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.075989 2574 generic.go:356] "Generic (PLEG): container finished" podID="ff2c56e2-c0e4-4c1b-8668-cac0a19a7919" containerID="af57882ed395554c464015b9cbad06d874145d6e512a1a51d52e3a97a43d428e" exitCode=0 Jun 13 03:44:36.076346 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.076077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" event={"ID":"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919","Type":"ContainerDied","Data":"af57882ed395554c464015b9cbad06d874145d6e512a1a51d52e3a97a43d428e"} Jun 13 03:44:36.080110 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.080089 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" event={"ID":"72c23acf-2ed0-49c1-9c38-e875dc76ebda","Type":"ContainerStarted","Data":"5a0da7eca642c4b8e6caa0b8c1b85b411f088998d8e903728f3584e12c5a8533"} Jun 13 03:44:36.080370 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.080353 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:36.080454 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.080416 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:36.080512 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.080469 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:36.095870 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.095850 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:36.095964 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.095940 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:44:36.124492 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.124453 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" podStartSLOduration=6.879051921 podStartE2EDuration="27.124440276s" totalImagesPullingTime="20.245388355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:36.122628726 +0000 UTC m=+27.753291333" watchObservedRunningTime="2026-06-13 03:44:36.124440276 +0000 UTC m=+27.755102865" Jun 13 03:44:36.843653 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:36.843615 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:36.844252 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:36.843760 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:37.521867 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:37.521832 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbxdr"] Jun 13 03:44:37.522025 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:37.521968 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:37.522065 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:37.522049 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:37.524423 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:37.524402 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8mk6x"] Jun 13 03:44:37.524555 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:37.524483 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:37.524606 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:37.524552 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:37.535220 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:37.535192 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzccg"] Jun 13 03:44:37.535340 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:37.535280 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:37.535400 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:37.535372 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:38.086184 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:38.086149 2574 generic.go:356] "Generic (PLEG): container finished" podID="ff2c56e2-c0e4-4c1b-8668-cac0a19a7919" containerID="4fe6d09fa43cdf320533a31ce780efb4c49dfca5fd698425291bf71cb95e8266" exitCode=0 Jun 13 03:44:38.086561 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:38.086227 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" event={"ID":"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919","Type":"ContainerDied","Data":"4fe6d09fa43cdf320533a31ce780efb4c49dfca5fd698425291bf71cb95e8266"} Jun 13 03:44:39.843296 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:39.843272 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:39.843643 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:39.843272 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:39.843643 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:39.843375 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:39.843643 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:39.843272 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:39.843643 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:39.843452 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:39.843643 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:39.843556 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:40.092669 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:40.092636 2574 generic.go:356] "Generic (PLEG): container finished" podID="ff2c56e2-c0e4-4c1b-8668-cac0a19a7919" containerID="8c5e86f18d39603df701f396e98d838bb5349342bb625cd461cf6db854ddf9e5" exitCode=0 Jun 13 03:44:40.092791 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:40.092689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" event={"ID":"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919","Type":"ContainerDied","Data":"8c5e86f18d39603df701f396e98d838bb5349342bb625cd461cf6db854ddf9e5"} Jun 13 03:44:41.541224 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:41.541189 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:41.541224 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:41.541237 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:41.541734 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.541358 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:41.541734 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.541433 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret podName:5c43ac6a-27cd-4733-8c96-05f58f2bdbd8 nodeName:}" failed. No retries permitted until 2026-06-13 03:45:13.54140992 +0000 UTC m=+65.172072487 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret") pod "global-pull-secret-syncer-vzccg" (UID: "5c43ac6a-27cd-4733-8c96-05f58f2bdbd8") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:41.541734 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.541366 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:41.541734 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.541531 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs podName:5249c400-ac62-4edd-b111-d6529a4e672d nodeName:}" failed. No retries permitted until 2026-06-13 03:45:13.54150624 +0000 UTC m=+65.172168812 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs") pod "network-metrics-daemon-tbxdr" (UID: "5249c400-ac62-4edd-b111-d6529a4e672d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:41.641960 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:41.641930 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:41.642114 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.642095 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:41.642189 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.642135 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:41.642189 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.642149 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xmdlw for pod openshift-network-diagnostics/network-check-target-8mk6x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:41.642289 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.642208 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw podName:c0c7484b-0184-4a95-9619-71bf929fdd1e nodeName:}" failed. No retries permitted until 2026-06-13 03:45:13.642190758 +0000 UTC m=+65.272853596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmdlw" (UniqueName: "kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw") pod "network-check-target-8mk6x" (UID: "c0c7484b-0184-4a95-9619-71bf929fdd1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:41.843707 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:41.843464 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:41.844098 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:41.843481 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:41.844098 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:41.843516 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:41.844098 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.843834 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:44:41.844098 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.843944 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzccg" podUID="5c43ac6a-27cd-4733-8c96-05f58f2bdbd8" Jun 13 03:44:41.844098 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:41.844029 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8mk6x" podUID="c0c7484b-0184-4a95-9619-71bf929fdd1e" Jun 13 03:44:43.166367 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.166288 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-206.ec2.internal" event="NodeReady" Jun 13 03:44:43.166797 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.166425 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 03:44:43.207791 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.207492 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xp674"] Jun 13 03:44:43.211806 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.211769 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kch4f"] Jun 13 03:44:43.211938 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.211891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.213678 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.213655 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kch4f" Jun 13 03:44:43.214406 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.214385 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 03:44:43.214515 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.214486 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-stzhf\"" Jun 13 03:44:43.214591 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.214576 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 03:44:43.216426 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.216405 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 03:44:43.216554 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.216481 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9h2wn\"" Jun 13 03:44:43.216554 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.216505 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 03:44:43.216758 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.216738 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 03:44:43.220227 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.220208 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xp674"] Jun 13 03:44:43.222738 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.222715 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kch4f"] Jun 13 03:44:43.255888 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.255867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.256002 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.255912 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/934bab98-9352-4baf-a814-242cadd9cbba-tmp-dir\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.256002 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.255972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a-cert\") pod \"ingress-canary-kch4f\" (UID: \"bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a\") " pod="openshift-ingress-canary/ingress-canary-kch4f" Jun 13 03:44:43.256147 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.256011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzvps\" (UniqueName: \"kubernetes.io/projected/bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a-kube-api-access-dzvps\") pod \"ingress-canary-kch4f\" (UID: \"bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a\") " pod="openshift-ingress-canary/ingress-canary-kch4f" Jun 13 03:44:43.256147 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.256034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/934bab98-9352-4baf-a814-242cadd9cbba-config-volume\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.256147 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.256087 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4nx9\" (UniqueName: \"kubernetes.io/projected/934bab98-9352-4baf-a814-242cadd9cbba-kube-api-access-n4nx9\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.356377 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.356349 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4nx9\" (UniqueName: \"kubernetes.io/projected/934bab98-9352-4baf-a814-242cadd9cbba-kube-api-access-n4nx9\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.356538 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.356389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.356538 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.356429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/934bab98-9352-4baf-a814-242cadd9cbba-tmp-dir\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.356538 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.356470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a-cert\") pod \"ingress-canary-kch4f\" (UID: \"bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a\") " pod="openshift-ingress-canary/ingress-canary-kch4f" Jun 13 03:44:43.356538 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.356507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzvps\" (UniqueName: \"kubernetes.io/projected/bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a-kube-api-access-dzvps\") pod \"ingress-canary-kch4f\" (UID: \"bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a\") " pod="openshift-ingress-canary/ingress-canary-kch4f" Jun 13 03:44:43.356538 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.356538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/934bab98-9352-4baf-a814-242cadd9cbba-config-volume\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.356774 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:43.356595 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:43.356774 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:43.356678 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls podName:934bab98-9352-4baf-a814-242cadd9cbba nodeName:}" failed. No retries permitted until 2026-06-13 03:44:43.856658186 +0000 UTC m=+35.487320772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls") pod "dns-default-xp674" (UID: "934bab98-9352-4baf-a814-242cadd9cbba") : secret "dns-default-metrics-tls" not found Jun 13 03:44:43.356925 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.356900 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/934bab98-9352-4baf-a814-242cadd9cbba-tmp-dir\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.357178 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.357162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/934bab98-9352-4baf-a814-242cadd9cbba-config-volume\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.361324 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.361307 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a-cert\") pod \"ingress-canary-kch4f\" (UID: \"bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a\") " pod="openshift-ingress-canary/ingress-canary-kch4f" Jun 13 03:44:43.367365 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.367344 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4nx9\" (UniqueName: \"kubernetes.io/projected/934bab98-9352-4baf-a814-242cadd9cbba-kube-api-access-n4nx9\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.367738 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.367708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzvps\" (UniqueName: \"kubernetes.io/projected/bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a-kube-api-access-dzvps\") pod \"ingress-canary-kch4f\" (UID: \"bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a\") " pod="openshift-ingress-canary/ingress-canary-kch4f" Jun 13 03:44:43.530742 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.530708 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kch4f" Jun 13 03:44:43.843839 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.843763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:44:43.843839 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.843777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:44:43.844054 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.843873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:44:43.846501 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.846464 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 03:44:43.846501 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.846498 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 03:44:43.846686 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.846502 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 03:44:43.847826 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.847739 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 03:44:43.847826 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.847756 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tqfh\"" Jun 13 03:44:43.847826 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.847739 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7pdj\"" Jun 13 03:44:43.858636 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:43.858615 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:43.858753 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:43.858737 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:43.858816 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:43.858806 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls podName:934bab98-9352-4baf-a814-242cadd9cbba nodeName:}" failed. No retries permitted until 2026-06-13 03:44:44.858787138 +0000 UTC m=+36.489449728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls") pod "dns-default-xp674" (UID: "934bab98-9352-4baf-a814-242cadd9cbba") : secret "dns-default-metrics-tls" not found Jun 13 03:44:44.416590 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:44.416482 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kch4f"] Jun 13 03:44:44.419449 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:44:44.419426 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9632cf_9f2f_4fef_a826_c1ae86cf4c5a.slice/crio-79dd4cc1085eb106ed54d6461704e4ab7081958fe4a0410452bf71653d2f2b12 WatchSource:0}: Error finding container 79dd4cc1085eb106ed54d6461704e4ab7081958fe4a0410452bf71653d2f2b12: Status 404 returned error can't find the container with id 79dd4cc1085eb106ed54d6461704e4ab7081958fe4a0410452bf71653d2f2b12 Jun 13 03:44:44.865061 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:44.865037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:44.865212 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:44.865197 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:44.865266 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:44.865260 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls podName:934bab98-9352-4baf-a814-242cadd9cbba nodeName:}" failed. No retries permitted until 2026-06-13 03:44:46.865239556 +0000 UTC m=+38.495902135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls") pod "dns-default-xp674" (UID: "934bab98-9352-4baf-a814-242cadd9cbba") : secret "dns-default-metrics-tls" not found Jun 13 03:44:45.107424 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:45.107390 2574 generic.go:356] "Generic (PLEG): container finished" podID="ff2c56e2-c0e4-4c1b-8668-cac0a19a7919" containerID="d761f8922f570ddcdb7b45564444d979b8de416eb3b054e0006240c3b365e4e7" exitCode=0 Jun 13 03:44:45.107587 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:45.107482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" event={"ID":"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919","Type":"ContainerDied","Data":"d761f8922f570ddcdb7b45564444d979b8de416eb3b054e0006240c3b365e4e7"} Jun 13 03:44:45.108947 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:45.108924 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kch4f" event={"ID":"bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a","Type":"ContainerStarted","Data":"79dd4cc1085eb106ed54d6461704e4ab7081958fe4a0410452bf71653d2f2b12"} Jun 13 03:44:46.117777 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:46.117745 2574 generic.go:356] "Generic (PLEG): container finished" podID="ff2c56e2-c0e4-4c1b-8668-cac0a19a7919" containerID="9a7109eb381290a8ed99818c1e0a027036c3f9a8b898ca2ecc8af58579e81449" exitCode=0 Jun 13 03:44:46.118164 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:46.117790 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" event={"ID":"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919","Type":"ContainerDied","Data":"9a7109eb381290a8ed99818c1e0a027036c3f9a8b898ca2ecc8af58579e81449"} Jun 13 03:44:46.879548 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:46.879518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:46.879710 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:46.879663 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:46.879749 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:46.879716 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls podName:934bab98-9352-4baf-a814-242cadd9cbba nodeName:}" failed. No retries permitted until 2026-06-13 03:44:50.87970071 +0000 UTC m=+42.510363283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls") pod "dns-default-xp674" (UID: "934bab98-9352-4baf-a814-242cadd9cbba") : secret "dns-default-metrics-tls" not found Jun 13 03:44:47.123354 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:47.123326 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" event={"ID":"ff2c56e2-c0e4-4c1b-8668-cac0a19a7919","Type":"ContainerStarted","Data":"71ff1e87f89d14e2135eb248b051f7f74f2a3eeae5d2d36f4c81a96d75d0a52f"} Jun 13 03:44:47.124781 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:47.124760 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kch4f" event={"ID":"bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a","Type":"ContainerStarted","Data":"21e92a8c371845926f8b0bad8103cb7e084ad9943149b36d253dde3ebbbc9b68"} Jun 13 03:44:47.145199 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:47.145116 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ckjmp" podStartSLOduration=7.354020985 podStartE2EDuration="38.145101746s" totalImagesPullingTime="30.791080761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:47.143446111 +0000 UTC m=+38.774108701" watchObservedRunningTime="2026-06-13 03:44:47.145101746 +0000 UTC m=+38.775764336" Jun 13 03:44:47.156931 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:47.156894 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kch4f" podStartSLOduration=2.424675598 podStartE2EDuration="4.156881307s" totalImagesPullingTime="1.732205709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:47.156034634 +0000 UTC m=+38.786697222" watchObservedRunningTime="2026-06-13 03:44:47.156881307 +0000 UTC m=+38.787543895" Jun 13 03:44:50.907396 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:50.907223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:50.907738 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:50.907358 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:50.907738 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:50.907454 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls podName:934bab98-9352-4baf-a814-242cadd9cbba nodeName:}" failed. No retries permitted until 2026-06-13 03:44:58.90744002 +0000 UTC m=+50.538102588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls") pod "dns-default-xp674" (UID: "934bab98-9352-4baf-a814-242cadd9cbba") : secret "dns-default-metrics-tls" not found Jun 13 03:44:58.961461 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:44:58.961425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:44:58.961952 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:58.961567 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:58.961952 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:44:58.961636 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls podName:934bab98-9352-4baf-a814-242cadd9cbba nodeName:}" failed. No retries permitted until 2026-06-13 03:45:14.961618453 +0000 UTC m=+66.592281025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls") pod "dns-default-xp674" (UID: "934bab98-9352-4baf-a814-242cadd9cbba") : secret "dns-default-metrics-tls" not found Jun 13 03:45:08.099975 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:08.099948 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-548bh" Jun 13 03:45:13.360204 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.360171 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz"] Jun 13 03:45:13.362956 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.362938 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" Jun 13 03:45:13.365437 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.365410 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 13 03:45:13.365541 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.365523 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 13 03:45:13.366874 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.366855 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 13 03:45:13.366984 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.366855 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 13 03:45:13.366984 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.366855 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nq74l\"" Jun 13 03:45:13.373095 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.373054 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz"] Jun 13 03:45:13.456114 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.456088 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldkp4\" (UniqueName: \"kubernetes.io/projected/0bdd55ba-09bc-4c7e-b0b3-12c15d424af9-kube-api-access-ldkp4\") pod \"managed-serviceaccount-addon-agent-fd4687898-tbwqz\" (UID: \"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" Jun 13 03:45:13.456235 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.456148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bdd55ba-09bc-4c7e-b0b3-12c15d424af9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fd4687898-tbwqz\" (UID: \"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" Jun 13 03:45:13.556559 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.556528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:45:13.556559 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.556565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:45:13.556729 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.556604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldkp4\" (UniqueName: \"kubernetes.io/projected/0bdd55ba-09bc-4c7e-b0b3-12c15d424af9-kube-api-access-ldkp4\") pod \"managed-serviceaccount-addon-agent-fd4687898-tbwqz\" (UID: \"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" Jun 13 03:45:13.556729 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.556623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bdd55ba-09bc-4c7e-b0b3-12c15d424af9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fd4687898-tbwqz\" (UID: \"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" Jun 13 03:45:13.559288 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.559268 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 03:45:13.559365 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.559268 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 03:45:13.560626 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.560607 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bdd55ba-09bc-4c7e-b0b3-12c15d424af9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fd4687898-tbwqz\" (UID: \"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" Jun 13 03:45:13.565077 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.565051 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldkp4\" (UniqueName: \"kubernetes.io/projected/0bdd55ba-09bc-4c7e-b0b3-12c15d424af9-kube-api-access-ldkp4\") pod \"managed-serviceaccount-addon-agent-fd4687898-tbwqz\" (UID: \"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" Jun 13 03:45:13.566797 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:45:13.566777 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 03:45:13.566892 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:45:13.566834 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs podName:5249c400-ac62-4edd-b111-d6529a4e672d nodeName:}" failed. No retries permitted until 2026-06-13 03:46:17.566815041 +0000 UTC m=+129.197477613 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs") pod "network-metrics-daemon-tbxdr" (UID: "5249c400-ac62-4edd-b111-d6529a4e672d") : secret "metrics-daemon-secret" not found Jun 13 03:45:13.568475 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.568455 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c43ac6a-27cd-4733-8c96-05f58f2bdbd8-original-pull-secret\") pod \"global-pull-secret-syncer-vzccg\" (UID: \"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8\") " pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:45:13.657885 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.657818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:45:13.660333 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.660317 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 03:45:13.670686 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.670669 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 03:45:13.681296 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.681272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmdlw\" (UniqueName: \"kubernetes.io/projected/c0c7484b-0184-4a95-9619-71bf929fdd1e-kube-api-access-xmdlw\") pod \"network-check-target-8mk6x\" (UID: \"c0c7484b-0184-4a95-9619-71bf929fdd1e\") " pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:45:13.687006 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.686988 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" Jun 13 03:45:13.803441 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.803416 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz"] Jun 13 03:45:13.806316 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:45:13.806287 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bdd55ba_09bc_4c7e_b0b3_12c15d424af9.slice/crio-07e1fe8d7b92ee6a3e40631f73472ec43d28a2e665c998f739cf7f7ce2f3beb8 WatchSource:0}: Error finding container 07e1fe8d7b92ee6a3e40631f73472ec43d28a2e665c998f739cf7f7ce2f3beb8: Status 404 returned error can't find the container with id 07e1fe8d7b92ee6a3e40631f73472ec43d28a2e665c998f739cf7f7ce2f3beb8 Jun 13 03:45:13.857569 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.857548 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tqfh\"" Jun 13 03:45:13.861627 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.861611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzccg" Jun 13 03:45:13.865723 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:13.865699 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:45:14.006241 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:14.006195 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzccg"] Jun 13 03:45:14.008804 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:45:14.008773 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c43ac6a_27cd_4733_8c96_05f58f2bdbd8.slice/crio-3fb444ae84e32367f841edeb0ddf87e8b6322646ead9b04d0cba8385a751993f WatchSource:0}: Error finding container 3fb444ae84e32367f841edeb0ddf87e8b6322646ead9b04d0cba8385a751993f: Status 404 returned error can't find the container with id 3fb444ae84e32367f841edeb0ddf87e8b6322646ead9b04d0cba8385a751993f Jun 13 03:45:14.022911 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:14.022873 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8mk6x"] Jun 13 03:45:14.024999 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:45:14.024976 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c7484b_0184_4a95_9619_71bf929fdd1e.slice/crio-a1dc5c0708610d25d27322d18140c756ed2606efe9f50385421742cf2961a6ae WatchSource:0}: Error finding container a1dc5c0708610d25d27322d18140c756ed2606efe9f50385421742cf2961a6ae: Status 404 returned error can't find the container with id a1dc5c0708610d25d27322d18140c756ed2606efe9f50385421742cf2961a6ae Jun 13 03:45:14.185408 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:14.185377 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" event={"ID":"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9","Type":"ContainerStarted","Data":"07e1fe8d7b92ee6a3e40631f73472ec43d28a2e665c998f739cf7f7ce2f3beb8"} Jun 13 03:45:14.186341 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:14.186323 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8mk6x" event={"ID":"c0c7484b-0184-4a95-9619-71bf929fdd1e","Type":"ContainerStarted","Data":"a1dc5c0708610d25d27322d18140c756ed2606efe9f50385421742cf2961a6ae"} Jun 13 03:45:14.187269 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:14.187232 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzccg" event={"ID":"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8","Type":"ContainerStarted","Data":"3fb444ae84e32367f841edeb0ddf87e8b6322646ead9b04d0cba8385a751993f"} Jun 13 03:45:14.965604 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:14.965565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:45:14.966011 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:45:14.965719 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:45:14.966011 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:45:14.965785 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls podName:934bab98-9352-4baf-a814-242cadd9cbba nodeName:}" failed. No retries permitted until 2026-06-13 03:45:46.965766333 +0000 UTC m=+98.596428902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls") pod "dns-default-xp674" (UID: "934bab98-9352-4baf-a814-242cadd9cbba") : secret "dns-default-metrics-tls" not found Jun 13 03:45:20.204869 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:20.204834 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" event={"ID":"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9","Type":"ContainerStarted","Data":"396e1443ae1389d725053bde7617c0868289b24da67533503e242129c2a0bc18"} Jun 13 03:45:20.206261 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:20.206239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8mk6x" event={"ID":"c0c7484b-0184-4a95-9619-71bf929fdd1e","Type":"ContainerStarted","Data":"8ea929d0db82f55c3dbaf8b90874011fda798aa4025cc2baabd0f708e9c76fb9"} Jun 13 03:45:20.206376 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:20.206313 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:45:20.207573 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:20.207550 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzccg" event={"ID":"5c43ac6a-27cd-4733-8c96-05f58f2bdbd8","Type":"ContainerStarted","Data":"b236da7f11ea689f54184a7f84f6e9e5014132d5fdbc94b40e3fd722fedfb02b"} Jun 13 03:45:20.220130 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:20.220089 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" podStartSLOduration=1.717960035 podStartE2EDuration="7.220076834s" totalImagesPullingTime="5.502116799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:45:20.219504239 +0000 UTC m=+71.850166828" watchObservedRunningTime="2026-06-13 03:45:20.220076834 +0000 UTC m=+71.850739423" Jun 13 03:45:20.236827 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:20.236788 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8mk6x" podStartSLOduration=65.962750184 podStartE2EDuration="1m11.236775467s" totalImagesPullingTime="5.274025283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:45:20.236291202 +0000 UTC m=+71.866953788" watchObservedRunningTime="2026-06-13 03:45:20.236775467 +0000 UTC m=+71.867438049" Jun 13 03:45:20.250768 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:20.250732 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vzccg" podStartSLOduration=65.945873758 podStartE2EDuration="1m11.250720275s" totalImagesPullingTime="5.304846517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:45:20.250244783 +0000 UTC m=+71.880907396" watchObservedRunningTime="2026-06-13 03:45:20.250720275 +0000 UTC m=+71.881382864" Jun 13 03:45:47.065030 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:47.064905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:45:47.065030 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:45:47.065014 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:45:47.065554 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:45:47.065082 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls podName:934bab98-9352-4baf-a814-242cadd9cbba nodeName:}" failed. No retries permitted until 2026-06-13 03:46:51.065064854 +0000 UTC m=+162.695727433 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls") pod "dns-default-xp674" (UID: "934bab98-9352-4baf-a814-242cadd9cbba") : secret "dns-default-metrics-tls" not found Jun 13 03:45:51.212143 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:45:51.212095 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8mk6x" Jun 13 03:46:17.656097 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:46:17.656053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:46:17.656580 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:46:17.656192 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 03:46:17.656580 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:46:17.656245 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs podName:5249c400-ac62-4edd-b111-d6529a4e672d nodeName:}" failed. No retries permitted until 2026-06-13 03:48:19.65623142 +0000 UTC m=+251.286893986 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs") pod "network-metrics-daemon-tbxdr" (UID: "5249c400-ac62-4edd-b111-d6529a4e672d") : secret "metrics-daemon-secret" not found Jun 13 03:46:46.225920 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:46:46.225884 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xp674" podUID="934bab98-9352-4baf-a814-242cadd9cbba" Jun 13 03:46:46.408005 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:46:46.407979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xp674" Jun 13 03:46:46.867256 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:46:46.867225 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tbxdr" podUID="5249c400-ac62-4edd-b111-d6529a4e672d" Jun 13 03:46:51.164418 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:46:51.164372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:46:51.164880 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:46:51.164481 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:46:51.164880 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:46:51.164533 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls podName:934bab98-9352-4baf-a814-242cadd9cbba nodeName:}" failed. No retries permitted until 2026-06-13 03:48:53.164518399 +0000 UTC m=+284.795180965 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls") pod "dns-default-xp674" (UID: "934bab98-9352-4baf-a814-242cadd9cbba") : secret "dns-default-metrics-tls" not found Jun 13 03:47:00.843617 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:00.843540 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:47:19.491322 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:19.491291 2574 generic.go:356] "Generic (PLEG): container finished" podID="0bdd55ba-09bc-4c7e-b0b3-12c15d424af9" containerID="396e1443ae1389d725053bde7617c0868289b24da67533503e242129c2a0bc18" exitCode=255 Jun 13 03:47:19.491658 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:19.491339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" event={"ID":"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9","Type":"ContainerDied","Data":"396e1443ae1389d725053bde7617c0868289b24da67533503e242129c2a0bc18"} Jun 13 03:47:19.501327 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:19.501309 2574 scope.go:117] "RemoveContainer" containerID="396e1443ae1389d725053bde7617c0868289b24da67533503e242129c2a0bc18" Jun 13 03:47:20.494801 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:20.494756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd4687898-tbwqz" event={"ID":"0bdd55ba-09bc-4c7e-b0b3-12c15d424af9","Type":"ContainerStarted","Data":"c6f67bb274974191db2f1fdb16d76efb0973e8db6fdfd9f669304c62012d4f13"} Jun 13 03:47:25.729878 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.729844 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-lbtld"] Jun 13 03:47:25.731468 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.731453 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lbtld" Jun 13 03:47:25.734057 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.734037 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-m86vn\"" Jun 13 03:47:25.736856 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.736835 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz"] Jun 13 03:47:25.738451 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.738434 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-gbtj5"] Jun 13 03:47:25.738591 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.738555 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz" Jun 13 03:47:25.740141 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.740110 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-8pcb5"] Jun 13 03:47:25.740227 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.740193 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.741157 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.741136 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8fjt7\"" Jun 13 03:47:25.741704 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.741686 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 13 03:47:25.741812 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.741709 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:47:25.741812 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.741732 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7457b66bd4-bfzh4"] Jun 13 03:47:25.741932 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.741902 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:25.742690 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.742673 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 13 03:47:25.742925 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.742911 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-w6k82\"" Jun 13 03:47:25.743172 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.743153 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:47:25.743329 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.743313 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.743668 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.743650 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 13 03:47:25.743819 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.743803 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 13 03:47:25.744543 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.744524 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-lbtld"] Jun 13 03:47:25.745803 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.745785 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 13 03:47:25.746100 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.745818 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bpgt6\"" Jun 13 03:47:25.746238 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.745823 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 13 03:47:25.747385 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.747365 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 03:47:25.747503 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.747487 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 03:47:25.747577 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.747560 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 03:47:25.747843 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.747828 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wrg5q\"" Jun 13 03:47:25.749807 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.749788 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 13 03:47:25.754838 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.754819 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz"] Jun 13 03:47:25.755308 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.755292 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-gbtj5"] Jun 13 03:47:25.756142 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.756107 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-8pcb5"] Jun 13 03:47:25.756238 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.756218 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 03:47:25.757165 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.757144 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7457b66bd4-bfzh4"] Jun 13 03:47:25.787157 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.787115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jmpx\" (UniqueName: \"kubernetes.io/projected/254728fe-5db9-4e9b-963a-5c81ce41f8e0-kube-api-access-7jmpx\") pod \"volume-data-source-validator-bd4ccd799-ljvnz\" (UID: \"254728fe-5db9-4e9b-963a-5c81ce41f8e0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz" Jun 13 03:47:25.787248 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.787176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b47462a-ec83-49b8-af0a-e5a3dac8866c-nginx-conf\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:25.787248 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.787212 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:25.888293 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.888393 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888296 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f57ca73-2110-41fd-90a4-905e63f261f4-ca-trust-extracted\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.888393 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-trusted-ca\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.888393 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888328 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-bound-sa-token\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.888393 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmcx\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-kube-api-access-7gmcx\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.888548 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888401 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jmpx\" (UniqueName: \"kubernetes.io/projected/254728fe-5db9-4e9b-963a-5c81ce41f8e0-kube-api-access-7jmpx\") pod \"volume-data-source-validator-bd4ccd799-ljvnz\" (UID: \"254728fe-5db9-4e9b-963a-5c81ce41f8e0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz" Jun 13 03:47:25.888548 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b47462a-ec83-49b8-af0a-e5a3dac8866c-nginx-conf\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:25.888548 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-trusted-ca\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.888548 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7cs2\" (UniqueName: \"kubernetes.io/projected/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-kube-api-access-x7cs2\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.888548 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-certificates\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.888548 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:25.888548 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m874j\" (UniqueName: \"kubernetes.io/projected/c61acc21-b3a6-4d29-b27a-f686c3a90507-kube-api-access-m874j\") pod \"network-check-source-6947749cfc-lbtld\" (UID: \"c61acc21-b3a6-4d29-b27a-f686c3a90507\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-lbtld" Jun 13 03:47:25.888762 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888626 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-config\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.888762 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:25.888649 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 03:47:25.888762 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:25.888707 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert podName:0b47462a-ec83-49b8-af0a-e5a3dac8866c nodeName:}" failed. No retries permitted until 2026-06-13 03:47:26.388694793 +0000 UTC m=+198.019357363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8pcb5" (UID: "0b47462a-ec83-49b8-af0a-e5a3dac8866c") : secret "networking-console-plugin-cert" not found Jun 13 03:47:25.888861 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-installation-pull-secrets\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.888861 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-serving-cert\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.888861 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.888852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-image-registry-private-configuration\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.889079 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.889062 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b47462a-ec83-49b8-af0a-e5a3dac8866c-nginx-conf\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:25.896283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.896260 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jmpx\" (UniqueName: \"kubernetes.io/projected/254728fe-5db9-4e9b-963a-5c81ce41f8e0-kube-api-access-7jmpx\") pod \"volume-data-source-validator-bd4ccd799-ljvnz\" (UID: \"254728fe-5db9-4e9b-963a-5c81ce41f8e0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz" Jun 13 03:47:25.989449 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m874j\" (UniqueName: \"kubernetes.io/projected/c61acc21-b3a6-4d29-b27a-f686c3a90507-kube-api-access-m874j\") pod \"network-check-source-6947749cfc-lbtld\" (UID: \"c61acc21-b3a6-4d29-b27a-f686c3a90507\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-lbtld" Jun 13 03:47:25.989449 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-config\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.989604 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-installation-pull-secrets\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.989641 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-serving-cert\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.989680 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989650 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-image-registry-private-configuration\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.989719 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.989719 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f57ca73-2110-41fd-90a4-905e63f261f4-ca-trust-extracted\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.989809 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989723 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-trusted-ca\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.989809 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-bound-sa-token\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.989809 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmcx\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-kube-api-access-7gmcx\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.990035 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-trusted-ca\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.990035 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7cs2\" (UniqueName: \"kubernetes.io/projected/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-kube-api-access-x7cs2\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.990035 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.989857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-certificates\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.990256 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.990150 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-config\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.990256 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.990152 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f57ca73-2110-41fd-90a4-905e63f261f4-ca-trust-extracted\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.990432 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.990412 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-certificates\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.990902 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.990881 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-trusted-ca\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.991027 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:25.991008 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:47:25.991080 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:25.991028 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7457b66bd4-bfzh4: secret "image-registry-tls" not found Jun 13 03:47:25.991143 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:25.991109 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls podName:2f57ca73-2110-41fd-90a4-905e63f261f4 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:26.491089517 +0000 UTC m=+198.121752104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls") pod "image-registry-7457b66bd4-bfzh4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4") : secret "image-registry-tls" not found Jun 13 03:47:25.991893 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.991874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-trusted-ca\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.992002 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.991979 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-installation-pull-secrets\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.992046 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.991995 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-serving-cert\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:25.992248 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.992230 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-image-registry-private-configuration\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:25.997920 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.997898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m874j\" (UniqueName: \"kubernetes.io/projected/c61acc21-b3a6-4d29-b27a-f686c3a90507-kube-api-access-m874j\") pod \"network-check-source-6947749cfc-lbtld\" (UID: \"c61acc21-b3a6-4d29-b27a-f686c3a90507\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-lbtld" Jun 13 03:47:25.999197 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:25.999176 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmcx\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-kube-api-access-7gmcx\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:26.000100 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.000081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7cs2\" (UniqueName: \"kubernetes.io/projected/12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4-kube-api-access-x7cs2\") pod \"console-operator-5dbbb5d744-gbtj5\" (UID: \"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:26.000396 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.000379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-bound-sa-token\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:26.040392 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.040371 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lbtld" Jun 13 03:47:26.050986 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.050966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz" Jun 13 03:47:26.058822 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.058801 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:26.179535 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.179508 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-lbtld"] Jun 13 03:47:26.183408 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:47:26.183376 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61acc21_b3a6_4d29_b27a_f686c3a90507.slice/crio-9ce31c5c494d9db81abfde4e81e0b3e08d04ae5b6c13506d0485253e0b514c98 WatchSource:0}: Error finding container 9ce31c5c494d9db81abfde4e81e0b3e08d04ae5b6c13506d0485253e0b514c98: Status 404 returned error can't find the container with id 9ce31c5c494d9db81abfde4e81e0b3e08d04ae5b6c13506d0485253e0b514c98 Jun 13 03:47:26.202343 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.202312 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz"] Jun 13 03:47:26.211503 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:47:26.211480 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254728fe_5db9_4e9b_963a_5c81ce41f8e0.slice/crio-b17fc72ae8198ac060dcb338262db5528694f619b94a29b2f9f33d511a867108 WatchSource:0}: Error finding container b17fc72ae8198ac060dcb338262db5528694f619b94a29b2f9f33d511a867108: Status 404 returned error can't find the container with id b17fc72ae8198ac060dcb338262db5528694f619b94a29b2f9f33d511a867108 Jun 13 03:47:26.212252 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.212228 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-gbtj5"] Jun 13 03:47:26.214758 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:47:26.214735 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d447f6_5d0f_4ba7_8bfa_c98b70deb6d4.slice/crio-62fb021d2b885832f5c064e9305fc4807b3acc0589ce5bf44314c18b0083916c WatchSource:0}: Error finding container 62fb021d2b885832f5c064e9305fc4807b3acc0589ce5bf44314c18b0083916c: Status 404 returned error can't find the container with id 62fb021d2b885832f5c064e9305fc4807b3acc0589ce5bf44314c18b0083916c Jun 13 03:47:26.394739 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.394709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:26.394886 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:26.394853 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 03:47:26.394928 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:26.394922 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert podName:0b47462a-ec83-49b8-af0a-e5a3dac8866c nodeName:}" failed. No retries permitted until 2026-06-13 03:47:27.394906145 +0000 UTC m=+199.025568712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8pcb5" (UID: "0b47462a-ec83-49b8-af0a-e5a3dac8866c") : secret "networking-console-plugin-cert" not found Jun 13 03:47:26.495981 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.495901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:26.496115 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:26.496017 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:47:26.496115 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:26.496028 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7457b66bd4-bfzh4: secret "image-registry-tls" not found Jun 13 03:47:26.496115 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:26.496079 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls podName:2f57ca73-2110-41fd-90a4-905e63f261f4 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:27.496064064 +0000 UTC m=+199.126726632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls") pod "image-registry-7457b66bd4-bfzh4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4") : secret "image-registry-tls" not found Jun 13 03:47:26.510719 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.510690 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz" event={"ID":"254728fe-5db9-4e9b-963a-5c81ce41f8e0","Type":"ContainerStarted","Data":"b17fc72ae8198ac060dcb338262db5528694f619b94a29b2f9f33d511a867108"} Jun 13 03:47:26.512144 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.512107 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lbtld" event={"ID":"c61acc21-b3a6-4d29-b27a-f686c3a90507","Type":"ContainerStarted","Data":"2fd3737ef76adb209285bf28f074d65666ea95260205880ef17e7a427235281a"} Jun 13 03:47:26.512267 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.512162 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lbtld" event={"ID":"c61acc21-b3a6-4d29-b27a-f686c3a90507","Type":"ContainerStarted","Data":"9ce31c5c494d9db81abfde4e81e0b3e08d04ae5b6c13506d0485253e0b514c98"} Jun 13 03:47:26.513227 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.513206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" event={"ID":"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4","Type":"ContainerStarted","Data":"62fb021d2b885832f5c064e9305fc4807b3acc0589ce5bf44314c18b0083916c"} Jun 13 03:47:26.527931 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:26.527893 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lbtld" podStartSLOduration=1.527880863 podStartE2EDuration="1.527880863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:26.527662945 +0000 UTC m=+198.158325535" watchObservedRunningTime="2026-06-13 03:47:26.527880863 +0000 UTC m=+198.158543499" Jun 13 03:47:27.404120 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:27.404056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:27.404588 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:27.404238 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 03:47:27.404588 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:27.404322 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert podName:0b47462a-ec83-49b8-af0a-e5a3dac8866c nodeName:}" failed. No retries permitted until 2026-06-13 03:47:29.404300381 +0000 UTC m=+201.034962950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8pcb5" (UID: "0b47462a-ec83-49b8-af0a-e5a3dac8866c") : secret "networking-console-plugin-cert" not found Jun 13 03:47:27.505212 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:27.505192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:27.505350 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:27.505335 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:47:27.505385 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:27.505351 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7457b66bd4-bfzh4: secret "image-registry-tls" not found Jun 13 03:47:27.505417 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:27.505399 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls podName:2f57ca73-2110-41fd-90a4-905e63f261f4 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:29.505381735 +0000 UTC m=+201.136044323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls") pod "image-registry-7457b66bd4-bfzh4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4") : secret "image-registry-tls" not found Jun 13 03:47:28.521517 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:28.521496 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/0.log" Jun 13 03:47:28.521886 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:28.521534 2574 generic.go:356] "Generic (PLEG): container finished" podID="12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4" containerID="39ffc92c1d152fc58479b18b21493d2b12e2df5ca1eeab7f426720509493b383" exitCode=255 Jun 13 03:47:28.521886 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:28.521568 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" event={"ID":"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4","Type":"ContainerDied","Data":"39ffc92c1d152fc58479b18b21493d2b12e2df5ca1eeab7f426720509493b383"} Jun 13 03:47:28.521886 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:28.521811 2574 scope.go:117] "RemoveContainer" containerID="39ffc92c1d152fc58479b18b21493d2b12e2df5ca1eeab7f426720509493b383" Jun 13 03:47:28.523154 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:28.523120 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz" event={"ID":"254728fe-5db9-4e9b-963a-5c81ce41f8e0","Type":"ContainerStarted","Data":"9e1a4f1904d5c276ee7c895ae60dcdab1e55979a3c6a6ecd170d99358dc72d92"} Jun 13 03:47:29.419256 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:29.419227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:29.419421 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:29.419385 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 03:47:29.419504 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:29.419456 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert podName:0b47462a-ec83-49b8-af0a-e5a3dac8866c nodeName:}" failed. No retries permitted until 2026-06-13 03:47:33.419437072 +0000 UTC m=+205.050099655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8pcb5" (UID: "0b47462a-ec83-49b8-af0a-e5a3dac8866c") : secret "networking-console-plugin-cert" not found Jun 13 03:47:29.519787 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:29.519745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:29.519945 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:29.519892 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:47:29.519945 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:29.519911 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7457b66bd4-bfzh4: secret "image-registry-tls" not found Jun 13 03:47:29.520011 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:29.519973 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls podName:2f57ca73-2110-41fd-90a4-905e63f261f4 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:33.519958915 +0000 UTC m=+205.150621482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls") pod "image-registry-7457b66bd4-bfzh4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4") : secret "image-registry-tls" not found Jun 13 03:47:29.527249 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:29.527229 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 03:47:29.527631 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:29.527616 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/0.log" Jun 13 03:47:29.527677 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:29.527649 2574 generic.go:356] "Generic (PLEG): container finished" podID="12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4" containerID="64c1be03e39de4a6e800c42bf9879d4c4958b5d83da667b701294cf859165d44" exitCode=255 Jun 13 03:47:29.527727 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:29.527714 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" event={"ID":"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4","Type":"ContainerDied","Data":"64c1be03e39de4a6e800c42bf9879d4c4958b5d83da667b701294cf859165d44"} Jun 13 03:47:29.527794 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:29.527784 2574 scope.go:117] "RemoveContainer" containerID="39ffc92c1d152fc58479b18b21493d2b12e2df5ca1eeab7f426720509493b383" Jun 13 03:47:29.527971 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:29.527951 2574 scope.go:117] "RemoveContainer" containerID="64c1be03e39de4a6e800c42bf9879d4c4958b5d83da667b701294cf859165d44" Jun 13 03:47:29.528173 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:29.528154 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-gbtj5_openshift-console-operator(12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" podUID="12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4" Jun 13 03:47:29.543145 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:29.543089 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-ljvnz" podStartSLOduration=3.262346455 podStartE2EDuration="4.543077467s" totalImagesPullingTime="1.280731012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:28.549453153 +0000 UTC m=+200.180115752" watchObservedRunningTime="2026-06-13 03:47:29.543077467 +0000 UTC m=+201.173740056" Jun 13 03:47:30.532624 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.532600 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 03:47:30.533072 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.532948 2574 scope.go:117] "RemoveContainer" containerID="64c1be03e39de4a6e800c42bf9879d4c4958b5d83da667b701294cf859165d44" Jun 13 03:47:30.533173 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:30.533145 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-gbtj5_openshift-console-operator(12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" podUID="12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4" Jun 13 03:47:30.825802 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.825731 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6bfwx"] Jun 13 03:47:30.828525 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.828509 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:30.831396 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.831363 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 03:47:30.831396 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.831361 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 03:47:30.831577 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.831416 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-64h9h\"" Jun 13 03:47:30.832620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.832597 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 03:47:30.832620 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.832617 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 03:47:30.836953 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.836935 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bfwx"] Jun 13 03:47:30.931267 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.931248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gng69\" (UniqueName: \"kubernetes.io/projected/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-api-access-gng69\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:30.931361 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.931287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:30.931361 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.931308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a5f9f2-1228-4752-aedf-4369219bb0f6-data-volume\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:30.931361 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.931328 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:30.931463 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:30.931434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24a5f9f2-1228-4752-aedf-4369219bb0f6-crio-socket\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.032517 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.032490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24a5f9f2-1228-4752-aedf-4369219bb0f6-crio-socket\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.032624 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.032528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gng69\" (UniqueName: \"kubernetes.io/projected/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-api-access-gng69\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.032624 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.032558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.032624 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.032577 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a5f9f2-1228-4752-aedf-4369219bb0f6-data-volume\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.032624 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.032603 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24a5f9f2-1228-4752-aedf-4369219bb0f6-crio-socket\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.032624 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.032600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.032871 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:31.032649 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:31.032871 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:31.032713 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:31.532699416 +0000 UTC m=+203.163362003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : configmap "kube-rbac-proxy" not found Jun 13 03:47:31.032871 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:31.032737 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:31.032871 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:31.032793 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:31.532775768 +0000 UTC m=+203.163438354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:31.033027 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.032912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a5f9f2-1228-4752-aedf-4369219bb0f6-data-volume\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.041015 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.040995 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gng69\" (UniqueName: \"kubernetes.io/projected/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-api-access-gng69\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.535464 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.535436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.535464 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:31.535465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:31.535898 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:31.535566 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:31.535898 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:31.535577 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:31.535898 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:31.535635 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:32.535622024 +0000 UTC m=+204.166284591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:31.535898 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:31.535647 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:32.53564066 +0000 UTC m=+204.166303227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : configmap "kube-rbac-proxy" not found Jun 13 03:47:32.523136 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.523090 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-ph6pf"] Jun 13 03:47:32.525016 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.524996 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.527654 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.527628 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mswc5\"" Jun 13 03:47:32.527760 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.527665 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 13 03:47:32.527831 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.527798 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 13 03:47:32.528934 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.528918 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 13 03:47:32.529171 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.529153 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 13 03:47:32.533969 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.533947 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-ph6pf"] Jun 13 03:47:32.541801 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.541783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c64639c-be94-4620-8361-3e8b0220d5a1-signing-key\") pod \"service-ca-7b994bc59-ph6pf\" (UID: \"5c64639c-be94-4620-8361-3e8b0220d5a1\") " pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.542056 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.541830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c64639c-be94-4620-8361-3e8b0220d5a1-signing-cabundle\") pod \"service-ca-7b994bc59-ph6pf\" (UID: \"5c64639c-be94-4620-8361-3e8b0220d5a1\") " pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.542056 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.541891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:32.542056 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.541915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:32.542056 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.541934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn9sw\" (UniqueName: \"kubernetes.io/projected/5c64639c-be94-4620-8361-3e8b0220d5a1-kube-api-access-bn9sw\") pod \"service-ca-7b994bc59-ph6pf\" (UID: \"5c64639c-be94-4620-8361-3e8b0220d5a1\") " pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.542056 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:32.542018 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:32.542056 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:32.542047 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:32.542293 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:32.542077 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:34.542060039 +0000 UTC m=+206.172722617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : configmap "kube-rbac-proxy" not found Jun 13 03:47:32.542293 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:32.542093 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:34.542085858 +0000 UTC m=+206.172748425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:32.642362 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.642338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c64639c-be94-4620-8361-3e8b0220d5a1-signing-key\") pod \"service-ca-7b994bc59-ph6pf\" (UID: \"5c64639c-be94-4620-8361-3e8b0220d5a1\") " pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.642453 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.642381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c64639c-be94-4620-8361-3e8b0220d5a1-signing-cabundle\") pod \"service-ca-7b994bc59-ph6pf\" (UID: \"5c64639c-be94-4620-8361-3e8b0220d5a1\") " pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.642513 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.642496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn9sw\" (UniqueName: \"kubernetes.io/projected/5c64639c-be94-4620-8361-3e8b0220d5a1-kube-api-access-bn9sw\") pod \"service-ca-7b994bc59-ph6pf\" (UID: \"5c64639c-be94-4620-8361-3e8b0220d5a1\") " pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.642935 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.642917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c64639c-be94-4620-8361-3e8b0220d5a1-signing-cabundle\") pod \"service-ca-7b994bc59-ph6pf\" (UID: \"5c64639c-be94-4620-8361-3e8b0220d5a1\") " pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.644645 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.644624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c64639c-be94-4620-8361-3e8b0220d5a1-signing-key\") pod \"service-ca-7b994bc59-ph6pf\" (UID: \"5c64639c-be94-4620-8361-3e8b0220d5a1\") " pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.650545 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.650522 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn9sw\" (UniqueName: \"kubernetes.io/projected/5c64639c-be94-4620-8361-3e8b0220d5a1-kube-api-access-bn9sw\") pod \"service-ca-7b994bc59-ph6pf\" (UID: \"5c64639c-be94-4620-8361-3e8b0220d5a1\") " pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.834745 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.834697 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" Jun 13 03:47:32.952223 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:32.952191 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-ph6pf"] Jun 13 03:47:32.955185 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:47:32.955160 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c64639c_be94_4620_8361_3e8b0220d5a1.slice/crio-6d2b65d86b9842de75a646297c82e4ebdf785e13cf3a5ddff64fd892176654d6 WatchSource:0}: Error finding container 6d2b65d86b9842de75a646297c82e4ebdf785e13cf3a5ddff64fd892176654d6: Status 404 returned error can't find the container with id 6d2b65d86b9842de75a646297c82e4ebdf785e13cf3a5ddff64fd892176654d6 Jun 13 03:47:33.450086 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:33.450052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:33.450263 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:33.450206 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 03:47:33.450323 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:33.450264 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert podName:0b47462a-ec83-49b8-af0a-e5a3dac8866c nodeName:}" failed. No retries permitted until 2026-06-13 03:47:41.450250015 +0000 UTC m=+213.080912585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8pcb5" (UID: "0b47462a-ec83-49b8-af0a-e5a3dac8866c") : secret "networking-console-plugin-cert" not found Jun 13 03:47:33.501314 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:33.501286 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hprjm_05ed7d04-f583-4e9a-8acb-74a8411da301/dns-node-resolver/0.log" Jun 13 03:47:33.544715 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:33.544686 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" event={"ID":"5c64639c-be94-4620-8361-3e8b0220d5a1","Type":"ContainerStarted","Data":"6d2b65d86b9842de75a646297c82e4ebdf785e13cf3a5ddff64fd892176654d6"} Jun 13 03:47:33.551110 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:33.551084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:33.551258 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:33.551240 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:47:33.551328 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:33.551261 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7457b66bd4-bfzh4: secret "image-registry-tls" not found Jun 13 03:47:33.551328 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:33.551324 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls podName:2f57ca73-2110-41fd-90a4-905e63f261f4 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:41.55130379 +0000 UTC m=+213.181966359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls") pod "image-registry-7457b66bd4-bfzh4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4") : secret "image-registry-tls" not found Jun 13 03:47:34.502577 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:34.502547 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdtxs_d873938a-d1bf-4847-a272-c8a9ef0cd6ad/node-ca/0.log" Jun 13 03:47:34.558866 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:34.558834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:34.559354 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:34.558873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:34.559354 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:34.558964 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:34.559354 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:34.559006 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:34.559354 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:34.559026 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:38.55901042 +0000 UTC m=+210.189672992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : configmap "kube-rbac-proxy" not found Jun 13 03:47:34.559354 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:34.559055 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:38.559039155 +0000 UTC m=+210.189701728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:35.551676 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:35.551641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" event={"ID":"5c64639c-be94-4620-8361-3e8b0220d5a1","Type":"ContainerStarted","Data":"d9b34a01a3e98629e31da5a52397b45ff96c910a6ff41dc454315100ebee6d36"} Jun 13 03:47:35.567513 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:35.567467 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-ph6pf" podStartSLOduration=1.774839471 podStartE2EDuration="3.567452441s" totalImagesPullingTime="1.79261297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:35.566665765 +0000 UTC m=+207.197328354" watchObservedRunningTime="2026-06-13 03:47:35.567452441 +0000 UTC m=+207.198115030" Jun 13 03:47:35.701490 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:35.701466 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kch4f_bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a/serve-healthcheck-canary/0.log" Jun 13 03:47:36.059575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:36.059537 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:36.059766 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:36.059597 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:36.059997 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:36.059981 2574 scope.go:117] "RemoveContainer" containerID="64c1be03e39de4a6e800c42bf9879d4c4958b5d83da667b701294cf859165d44" Jun 13 03:47:36.060200 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:36.060179 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-gbtj5_openshift-console-operator(12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" podUID="12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4" Jun 13 03:47:38.590790 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:38.590761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:38.590790 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:38.590796 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:38.591227 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:38.590876 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:38.591227 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:38.590930 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:46.590915953 +0000 UTC m=+218.221578525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : configmap "kube-rbac-proxy" not found Jun 13 03:47:38.591227 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:38.590943 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:38.591227 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:38.590982 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls podName:24a5f9f2-1228-4752-aedf-4369219bb0f6 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:46.590970873 +0000 UTC m=+218.221633440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6bfwx" (UID: "24a5f9f2-1228-4752-aedf-4369219bb0f6") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:41.518219 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:41.518175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:41.518667 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:41.518333 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 03:47:41.518667 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:47:41.518445 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert podName:0b47462a-ec83-49b8-af0a-e5a3dac8866c nodeName:}" failed. No retries permitted until 2026-06-13 03:47:57.518422015 +0000 UTC m=+229.149084581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-8pcb5" (UID: "0b47462a-ec83-49b8-af0a-e5a3dac8866c") : secret "networking-console-plugin-cert" not found Jun 13 03:47:41.619533 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:41.619496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:41.622017 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:41.621995 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") pod \"image-registry-7457b66bd4-bfzh4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:41.670041 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:41.670011 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:41.795700 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:41.795680 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7457b66bd4-bfzh4"] Jun 13 03:47:41.798009 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:47:41.797981 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f57ca73_2110_41fd_90a4_905e63f261f4.slice/crio-3c7d82d2911791297e27bd9cd48f94c589c470577961690923f4af9736c86cf0 WatchSource:0}: Error finding container 3c7d82d2911791297e27bd9cd48f94c589c470577961690923f4af9736c86cf0: Status 404 returned error can't find the container with id 3c7d82d2911791297e27bd9cd48f94c589c470577961690923f4af9736c86cf0 Jun 13 03:47:42.575233 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:42.575195 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" event={"ID":"2f57ca73-2110-41fd-90a4-905e63f261f4","Type":"ContainerStarted","Data":"8aeaebf8d036fccd41bd8e5cb3226a55c1aae112fc1352ed4c9886812268878a"} Jun 13 03:47:42.575681 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:42.575251 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" event={"ID":"2f57ca73-2110-41fd-90a4-905e63f261f4","Type":"ContainerStarted","Data":"3c7d82d2911791297e27bd9cd48f94c589c470577961690923f4af9736c86cf0"} Jun 13 03:47:42.575681 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:42.575287 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:47:42.595370 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:42.595316 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" podStartSLOduration=17.595303213 podStartE2EDuration="17.595303213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:42.593979305 +0000 UTC m=+214.224641898" watchObservedRunningTime="2026-06-13 03:47:42.595303213 +0000 UTC m=+214.225965831" Jun 13 03:47:46.662208 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:46.662167 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:46.662666 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:46.662214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:46.662730 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:46.662671 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24a5f9f2-1228-4752-aedf-4369219bb0f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:46.664506 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:46.664483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24a5f9f2-1228-4752-aedf-4369219bb0f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bfwx\" (UID: \"24a5f9f2-1228-4752-aedf-4369219bb0f6\") " pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:46.736876 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:46.736844 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bfwx" Jun 13 03:47:46.857931 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:46.857901 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bfwx"] Jun 13 03:47:46.862307 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:47:46.862285 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a5f9f2_1228_4752_aedf_4369219bb0f6.slice/crio-1fd022302a2e107ef4b00221dde756554f0e32ea12a513c6858d5b8408368d14 WatchSource:0}: Error finding container 1fd022302a2e107ef4b00221dde756554f0e32ea12a513c6858d5b8408368d14: Status 404 returned error can't find the container with id 1fd022302a2e107ef4b00221dde756554f0e32ea12a513c6858d5b8408368d14 Jun 13 03:47:47.592979 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:47.592942 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bfwx" event={"ID":"24a5f9f2-1228-4752-aedf-4369219bb0f6","Type":"ContainerStarted","Data":"1fd022302a2e107ef4b00221dde756554f0e32ea12a513c6858d5b8408368d14"} Jun 13 03:47:50.604096 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:50.604061 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bfwx" event={"ID":"24a5f9f2-1228-4752-aedf-4369219bb0f6","Type":"ContainerStarted","Data":"ceeb7262d0d507afbe4072e4e44b34e8e8b6ebf176fa5b3240fdb0a36fe87d37"} Jun 13 03:47:51.610097 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:51.610055 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bfwx" event={"ID":"24a5f9f2-1228-4752-aedf-4369219bb0f6","Type":"ContainerStarted","Data":"b57435cf9dec1bb978f0c8f38513922630033bd7e9475d7016291f0319dd076d"} Jun 13 03:47:51.843309 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:51.843282 2574 scope.go:117] "RemoveContainer" containerID="64c1be03e39de4a6e800c42bf9879d4c4958b5d83da667b701294cf859165d44" Jun 13 03:47:52.116718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.116681 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7457b66bd4-bfzh4"] Jun 13 03:47:52.143212 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.143145 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-db8dc949-5s4k9"] Jun 13 03:47:52.145732 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.145713 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.156677 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.156645 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-db8dc949-5s4k9"] Jun 13 03:47:52.206739 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.206710 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323d7022-5268-4c98-b8be-b67c1cfbb854-registry-tls\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.206854 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.206756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/323d7022-5268-4c98-b8be-b67c1cfbb854-image-registry-private-configuration\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.206854 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.206821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/323d7022-5268-4c98-b8be-b67c1cfbb854-installation-pull-secrets\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.206965 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.206858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/323d7022-5268-4c98-b8be-b67c1cfbb854-bound-sa-token\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.206965 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.206916 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/323d7022-5268-4c98-b8be-b67c1cfbb854-registry-certificates\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.206965 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.206933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq5hb\" (UniqueName: \"kubernetes.io/projected/323d7022-5268-4c98-b8be-b67c1cfbb854-kube-api-access-jq5hb\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.207108 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.207018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/323d7022-5268-4c98-b8be-b67c1cfbb854-ca-trust-extracted\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.207108 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.207077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/323d7022-5268-4c98-b8be-b67c1cfbb854-trusted-ca\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.307921 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.307830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/323d7022-5268-4c98-b8be-b67c1cfbb854-ca-trust-extracted\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.307921 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.307900 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/323d7022-5268-4c98-b8be-b67c1cfbb854-trusted-ca\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.308236 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.307940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323d7022-5268-4c98-b8be-b67c1cfbb854-registry-tls\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.308236 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.308185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/323d7022-5268-4c98-b8be-b67c1cfbb854-image-registry-private-configuration\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.308343 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.308234 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/323d7022-5268-4c98-b8be-b67c1cfbb854-installation-pull-secrets\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.308343 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.308265 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/323d7022-5268-4c98-b8be-b67c1cfbb854-bound-sa-token\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.308343 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.308292 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/323d7022-5268-4c98-b8be-b67c1cfbb854-ca-trust-extracted\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.308343 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.308336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/323d7022-5268-4c98-b8be-b67c1cfbb854-registry-certificates\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.308519 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.308370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq5hb\" (UniqueName: \"kubernetes.io/projected/323d7022-5268-4c98-b8be-b67c1cfbb854-kube-api-access-jq5hb\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.309023 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.308979 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/323d7022-5268-4c98-b8be-b67c1cfbb854-trusted-ca\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.309240 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.309197 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/323d7022-5268-4c98-b8be-b67c1cfbb854-registry-certificates\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.311251 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.311232 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/323d7022-5268-4c98-b8be-b67c1cfbb854-image-registry-private-configuration\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.311487 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.311463 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323d7022-5268-4c98-b8be-b67c1cfbb854-registry-tls\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.311586 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.311553 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/323d7022-5268-4c98-b8be-b67c1cfbb854-installation-pull-secrets\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.316876 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.316854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq5hb\" (UniqueName: \"kubernetes.io/projected/323d7022-5268-4c98-b8be-b67c1cfbb854-kube-api-access-jq5hb\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.317272 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.317251 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/323d7022-5268-4c98-b8be-b67c1cfbb854-bound-sa-token\") pod \"image-registry-db8dc949-5s4k9\" (UID: \"323d7022-5268-4c98-b8be-b67c1cfbb854\") " pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.456537 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.456497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:52.615718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.615692 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 03:47:52.616060 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.615765 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" event={"ID":"12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4","Type":"ContainerStarted","Data":"25c354b44870508a9e4b118814748f45cfb1f4c42bc5c6dd342e7d4baa432830"} Jun 13 03:47:52.616060 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.616040 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:52.631904 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.631857 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" podStartSLOduration=25.686126864 podStartE2EDuration="27.631838697s" totalImagesPullingTime="1.945711833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:52.631338957 +0000 UTC m=+224.262001561" watchObservedRunningTime="2026-06-13 03:47:52.631838697 +0000 UTC m=+224.262501286" Jun 13 03:47:52.746463 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.746437 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-db8dc949-5s4k9"] Jun 13 03:47:52.749400 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:47:52.749373 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323d7022_5268_4c98_b8be_b67c1cfbb854.slice/crio-f1e7f612bc6aa1624790ad3aa0b056397e70840b7a82f4ff33eef7dd7ae54f2f WatchSource:0}: Error finding container f1e7f612bc6aa1624790ad3aa0b056397e70840b7a82f4ff33eef7dd7ae54f2f: Status 404 returned error can't find the container with id f1e7f612bc6aa1624790ad3aa0b056397e70840b7a82f4ff33eef7dd7ae54f2f Jun 13 03:47:52.981658 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:52.981581 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-gbtj5" Jun 13 03:47:53.152618 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.152585 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-tzqjl"] Jun 13 03:47:53.157166 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.157145 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-tzqjl" Jun 13 03:47:53.159601 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.159583 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 03:47:53.159667 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.159604 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 03:47:53.159745 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.159730 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8njmb\"" Jun 13 03:47:53.164091 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.163846 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-tzqjl"] Jun 13 03:47:53.216878 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.216848 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5cpq\" (UniqueName: \"kubernetes.io/projected/73011311-2adb-495a-98fc-8d9bcd152ac1-kube-api-access-w5cpq\") pod \"downloads-694c955b9-tzqjl\" (UID: \"73011311-2adb-495a-98fc-8d9bcd152ac1\") " pod="openshift-console/downloads-694c955b9-tzqjl" Jun 13 03:47:53.317212 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.317146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5cpq\" (UniqueName: \"kubernetes.io/projected/73011311-2adb-495a-98fc-8d9bcd152ac1-kube-api-access-w5cpq\") pod \"downloads-694c955b9-tzqjl\" (UID: \"73011311-2adb-495a-98fc-8d9bcd152ac1\") " pod="openshift-console/downloads-694c955b9-tzqjl" Jun 13 03:47:53.324388 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.324360 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5cpq\" (UniqueName: \"kubernetes.io/projected/73011311-2adb-495a-98fc-8d9bcd152ac1-kube-api-access-w5cpq\") pod \"downloads-694c955b9-tzqjl\" (UID: \"73011311-2adb-495a-98fc-8d9bcd152ac1\") " pod="openshift-console/downloads-694c955b9-tzqjl" Jun 13 03:47:53.466189 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.466158 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-tzqjl" Jun 13 03:47:53.598260 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.598194 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-tzqjl"] Jun 13 03:47:53.601068 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:47:53.601042 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73011311_2adb_495a_98fc_8d9bcd152ac1.slice/crio-1ce1631c26c5dacbe2b74d19bb13fd100e88d130291a1e54a5113729b46287cf WatchSource:0}: Error finding container 1ce1631c26c5dacbe2b74d19bb13fd100e88d130291a1e54a5113729b46287cf: Status 404 returned error can't find the container with id 1ce1631c26c5dacbe2b74d19bb13fd100e88d130291a1e54a5113729b46287cf Jun 13 03:47:53.622363 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.621878 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bfwx" event={"ID":"24a5f9f2-1228-4752-aedf-4369219bb0f6","Type":"ContainerStarted","Data":"1e7da78f7c8f714f4b0cfba7f312bab4f5de48e9584764348e661f164c8fecf4"} Jun 13 03:47:53.626981 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.626958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-tzqjl" event={"ID":"73011311-2adb-495a-98fc-8d9bcd152ac1","Type":"ContainerStarted","Data":"1ce1631c26c5dacbe2b74d19bb13fd100e88d130291a1e54a5113729b46287cf"} Jun 13 03:47:53.628407 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.628382 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" event={"ID":"323d7022-5268-4c98-b8be-b67c1cfbb854","Type":"ContainerStarted","Data":"89162b3949641815462e1f770063cc46776bfa181a4190c51482c218987428eb"} Jun 13 03:47:53.628495 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.628419 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" event={"ID":"323d7022-5268-4c98-b8be-b67c1cfbb854","Type":"ContainerStarted","Data":"f1e7f612bc6aa1624790ad3aa0b056397e70840b7a82f4ff33eef7dd7ae54f2f"} Jun 13 03:47:53.642643 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.642604 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6bfwx" podStartSLOduration=17.947191677 podStartE2EDuration="23.642590155s" totalImagesPullingTime="5.695398478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:47:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:53.641363243 +0000 UTC m=+225.272025831" watchObservedRunningTime="2026-06-13 03:47:53.642590155 +0000 UTC m=+225.273252744" Jun 13 03:47:53.660066 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:53.660025 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podStartSLOduration=1.6600140209999998 podStartE2EDuration="1.660014021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:53.659791886 +0000 UTC m=+225.290454487" watchObservedRunningTime="2026-06-13 03:47:53.660014021 +0000 UTC m=+225.290676609" Jun 13 03:47:54.631540 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:54.631502 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:47:57.554735 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:57.554699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:57.557281 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:57.557251 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b47462a-ec83-49b8-af0a-e5a3dac8866c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-8pcb5\" (UID: \"0b47462a-ec83-49b8-af0a-e5a3dac8866c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:57.565002 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:57.564978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" Jun 13 03:47:57.694046 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:57.694013 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-8pcb5"] Jun 13 03:47:57.718807 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:47:57.718777 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b47462a_ec83_49b8_af0a_e5a3dac8866c.slice/crio-29d7d9a671235829b20cb4315f122e5219a0ce61a5e921d1c3e9939a1b0e0e7f WatchSource:0}: Error finding container 29d7d9a671235829b20cb4315f122e5219a0ce61a5e921d1c3e9939a1b0e0e7f: Status 404 returned error can't find the container with id 29d7d9a671235829b20cb4315f122e5219a0ce61a5e921d1c3e9939a1b0e0e7f Jun 13 03:47:58.648270 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:58.648228 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" event={"ID":"0b47462a-ec83-49b8-af0a-e5a3dac8866c","Type":"ContainerStarted","Data":"29d7d9a671235829b20cb4315f122e5219a0ce61a5e921d1c3e9939a1b0e0e7f"} Jun 13 03:47:59.653642 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:59.653599 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" event={"ID":"0b47462a-ec83-49b8-af0a-e5a3dac8866c","Type":"ContainerStarted","Data":"18a0c8c40b2d346f1806dfed53c9cda3556e4003a0ae4e7f4f3e1825a013f405"} Jun 13 03:47:59.669807 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:47:59.669750 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-8pcb5" podStartSLOduration=33.336728681 podStartE2EDuration="34.669731114s" totalImagesPullingTime="1.333002433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:59.668795723 +0000 UTC m=+231.299458313" watchObservedRunningTime="2026-06-13 03:47:59.669731114 +0000 UTC m=+231.300393705" Jun 13 03:48:02.122660 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:02.122625 2574 patch_prober.go:28] interesting pod/image-registry-7457b66bd4-bfzh4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:02.123108 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:02.122687 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" podUID="2f57ca73-2110-41fd-90a4-905e63f261f4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:07.361412 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.361365 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w"] Jun 13 03:48:07.366574 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.366551 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mhzjp"] Jun 13 03:48:07.366704 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.366677 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.369235 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.369213 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 13 03:48:07.369693 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.369675 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 13 03:48:07.370230 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.370117 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 03:48:07.371602 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.370560 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 03:48:07.371602 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.371068 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 03:48:07.371602 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.371314 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zfdpk\"" Jun 13 03:48:07.373900 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.373405 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.379013 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.378996 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 03:48:07.379813 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.379755 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 03:48:07.379928 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.379866 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w"] Jun 13 03:48:07.380097 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.380021 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9br6t\"" Jun 13 03:48:07.380390 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.380370 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 03:48:07.539319 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38f579ae-addd-41d7-986f-9dcd4d05b9d3-root\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.539319 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-textfile\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.539319 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.539615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-wtmp\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.539615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.539615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38f579ae-addd-41d7-986f-9dcd4d05b9d3-metrics-client-ca\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.539615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9qqf\" (UniqueName: \"kubernetes.io/projected/38f579ae-addd-41d7-986f-9dcd4d05b9d3-kube-api-access-s9qqf\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.539615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b480708d-72d2-4632-8e70-16ab1bfd317e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.539615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539568 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b480708d-72d2-4632-8e70-16ab1bfd317e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.539615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b480708d-72d2-4632-8e70-16ab1bfd317e-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.539615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75p5g\" (UniqueName: \"kubernetes.io/projected/b480708d-72d2-4632-8e70-16ab1bfd317e-kube-api-access-75p5g\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.540040 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38f579ae-addd-41d7-986f-9dcd4d05b9d3-sys\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.540040 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.539698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-tls\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641253 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b480708d-72d2-4632-8e70-16ab1bfd317e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.641253 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b480708d-72d2-4632-8e70-16ab1bfd317e-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.641462 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75p5g\" (UniqueName: \"kubernetes.io/projected/b480708d-72d2-4632-8e70-16ab1bfd317e-kube-api-access-75p5g\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.641462 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38f579ae-addd-41d7-986f-9dcd4d05b9d3-sys\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-tls\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38f579ae-addd-41d7-986f-9dcd4d05b9d3-root\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-textfile\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641741 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641741 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-wtmp\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641741 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641741 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38f579ae-addd-41d7-986f-9dcd4d05b9d3-metrics-client-ca\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641741 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9qqf\" (UniqueName: \"kubernetes.io/projected/38f579ae-addd-41d7-986f-9dcd4d05b9d3-kube-api-access-s9qqf\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.641741 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38f579ae-addd-41d7-986f-9dcd4d05b9d3-root\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.642046 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641765 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b480708d-72d2-4632-8e70-16ab1bfd317e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.642046 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.641963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b480708d-72d2-4632-8e70-16ab1bfd317e-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.642046 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.642017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-textfile\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.642046 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.642035 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38f579ae-addd-41d7-986f-9dcd4d05b9d3-sys\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.642841 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:48:07.642421 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 13 03:48:07.642841 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:48:07.642491 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-tls podName:38f579ae-addd-41d7-986f-9dcd4d05b9d3 nodeName:}" failed. No retries permitted until 2026-06-13 03:48:08.14247324 +0000 UTC m=+239.773135815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-tls") pod "node-exporter-mhzjp" (UID: "38f579ae-addd-41d7-986f-9dcd4d05b9d3") : secret "node-exporter-tls" not found Jun 13 03:48:07.642841 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.642581 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.642841 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.642658 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38f579ae-addd-41d7-986f-9dcd4d05b9d3-metrics-client-ca\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.642841 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.642708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-wtmp\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.645119 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.645095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b480708d-72d2-4632-8e70-16ab1bfd317e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.645557 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.645534 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b480708d-72d2-4632-8e70-16ab1bfd317e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.645674 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.645635 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.650519 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.650498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9qqf\" (UniqueName: \"kubernetes.io/projected/38f579ae-addd-41d7-986f-9dcd4d05b9d3-kube-api-access-s9qqf\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:07.651466 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.651443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75p5g\" (UniqueName: \"kubernetes.io/projected/b480708d-72d2-4632-8e70-16ab1bfd317e-kube-api-access-75p5g\") pod \"openshift-state-metrics-6b8d965dd5-k2q9w\" (UID: \"b480708d-72d2-4632-8e70-16ab1bfd317e\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:07.685546 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:07.685525 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" Jun 13 03:48:08.146647 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.146612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-tls\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:08.148973 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.148951 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38f579ae-addd-41d7-986f-9dcd4d05b9d3-node-exporter-tls\") pod \"node-exporter-mhzjp\" (UID: \"38f579ae-addd-41d7-986f-9dcd4d05b9d3\") " pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:08.292717 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.292677 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mhzjp" Jun 13 03:48:08.440343 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.440308 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 03:48:08.444890 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.444860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.448354 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.448332 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 03:48:08.448354 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.448349 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 03:48:08.448968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.448708 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 03:48:08.448968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.448729 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 03:48:08.448968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.448770 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 03:48:08.448968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.448804 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 03:48:08.448968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.448731 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 03:48:08.448968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.448837 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 03:48:08.449362 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.449000 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7hqjk\"" Jun 13 03:48:08.449362 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.449097 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 03:48:08.462243 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.462219 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 03:48:08.475113 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.475087 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-856fb87fdf-w5ft7"] Jun 13 03:48:08.478680 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.478638 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.481748 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.481595 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 03:48:08.481748 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.481628 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 03:48:08.481748 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.481629 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 03:48:08.481957 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.481880 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7kzdx\"" Jun 13 03:48:08.481957 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.481897 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 03:48:08.482482 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.482209 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 03:48:08.487010 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.486971 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 13 03:48:08.488870 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.488850 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-856fb87fdf-w5ft7"] Jun 13 03:48:08.549563 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.549702 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549574 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.549702 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.549702 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-out\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.549923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.549923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-web-config\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.549923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.549923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.549923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8fcn\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-kube-api-access-f8fcn\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.549923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.550253 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.550253 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.549997 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.550253 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.550025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650504 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650504 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8fcn\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-kube-api-access-f8fcn\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650717 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650717 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-trusted-ca-bundle\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.650717 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650626 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650717 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-oauth-config\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.650717 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvk2f\" (UniqueName: \"kubernetes.io/projected/7084595e-a9cc-4aff-a602-4126c54ffaf8-kube-api-access-qvk2f\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.650968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650749 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650823 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-config\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.650968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-oauth-serving-cert\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.650968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650943 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.650968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.650952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.651389 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.651008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-service-ca\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.651389 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.651037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-out\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.651389 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.651084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.651389 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.651112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-web-config\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.651389 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.651163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.651389 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.651194 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-serving-cert\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.651389 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.651291 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.651728 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:48:08.651397 2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 13 03:48:08.651728 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:48:08.651466 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls podName:e9b9c71d-f47c-4761-b68d-e562d1701bb7 nodeName:}" failed. No retries permitted until 2026-06-13 03:48:09.151444766 +0000 UTC m=+240.782107335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7") : secret "alertmanager-main-tls" not found Jun 13 03:48:08.651881 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.651857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.654611 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.654565 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-web-config\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.654611 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.654588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.654789 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.654620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.655073 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.655030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.655775 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.655675 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.655775 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.655726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-out\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.655938 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.655868 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.656874 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.656852 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.658720 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.658695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8fcn\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-kube-api-access-f8fcn\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:08.752465 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.752139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-trusted-ca-bundle\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.752465 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.752195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-oauth-config\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.752465 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.752227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvk2f\" (UniqueName: \"kubernetes.io/projected/7084595e-a9cc-4aff-a602-4126c54ffaf8-kube-api-access-qvk2f\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.752465 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.752279 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-config\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.752465 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.752317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-oauth-serving-cert\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.752465 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.752371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-service-ca\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.752465 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.752419 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-serving-cert\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.755009 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.754985 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 03:48:08.755146 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.755044 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 03:48:08.755146 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.755057 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 03:48:08.755468 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.755381 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 03:48:08.755558 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.755490 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 03:48:08.763644 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.763615 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 13 03:48:08.764319 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.764249 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-service-ca\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.765067 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.764297 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-oauth-serving-cert\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.765218 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.765195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvk2f\" (UniqueName: \"kubernetes.io/projected/7084595e-a9cc-4aff-a602-4126c54ffaf8-kube-api-access-qvk2f\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.765545 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.765520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-config\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.765962 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.765938 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-trusted-ca-bundle\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.766255 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.766232 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-serving-cert\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.767871 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.767848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-oauth-config\") pod \"console-856fb87fdf-w5ft7\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:08.792963 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.792940 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7kzdx\"" Jun 13 03:48:08.800710 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:08.800694 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:09.155962 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:09.155870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:09.156106 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:48:09.156058 2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 13 03:48:09.156175 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:48:09.156146 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls podName:e9b9c71d-f47c-4761-b68d-e562d1701bb7 nodeName:}" failed. No retries permitted until 2026-06-13 03:48:10.156109958 +0000 UTC m=+241.786772527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7") : secret "alertmanager-main-tls" not found Jun 13 03:48:10.164928 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.164897 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:10.167943 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.167907 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:10.260077 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.260047 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7hqjk\"" Jun 13 03:48:10.268558 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.268534 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:48:10.344342 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.344313 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58bf4686fb-9xb7v"] Jun 13 03:48:10.348426 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.348406 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.351286 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.351265 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 13 03:48:10.351549 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.351528 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-v8jv5\"" Jun 13 03:48:10.351634 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.351559 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 13 03:48:10.351634 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.351582 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 13 03:48:10.351737 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.351529 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1e0t20i1ncg6s\"" Jun 13 03:48:10.351737 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.351529 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 13 03:48:10.351737 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.351529 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 13 03:48:10.358659 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.358587 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58bf4686fb-9xb7v"] Jun 13 03:48:10.466742 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.466702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-grpc-tls\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.466907 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.466767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.466907 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.466814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdz6p\" (UniqueName: \"kubernetes.io/projected/4f0101cb-a377-4ff4-b139-6c81774428ba-kube-api-access-kdz6p\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.466907 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.466846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.467077 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.466915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.467077 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.466954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-tls\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.467077 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.467033 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f0101cb-a377-4ff4-b139-6c81774428ba-metrics-client-ca\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.467232 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.467077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.567644 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.567603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.567813 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.567655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.567813 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.567687 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-tls\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.567813 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.567719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f0101cb-a377-4ff4-b139-6c81774428ba-metrics-client-ca\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.567813 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.567766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.568005 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.567821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-grpc-tls\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.568005 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.567866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.568005 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.567910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdz6p\" (UniqueName: \"kubernetes.io/projected/4f0101cb-a377-4ff4-b139-6c81774428ba-kube-api-access-kdz6p\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.568839 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.568596 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f0101cb-a377-4ff4-b139-6c81774428ba-metrics-client-ca\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.570765 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.570737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.570866 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.570822 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-tls\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.571411 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.571384 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.571515 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.571405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.571826 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.571796 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.571934 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.571873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f0101cb-a377-4ff4-b139-6c81774428ba-secret-grpc-tls\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.575908 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.575864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdz6p\" (UniqueName: \"kubernetes.io/projected/4f0101cb-a377-4ff4-b139-6c81774428ba-kube-api-access-kdz6p\") pod \"thanos-querier-58bf4686fb-9xb7v\" (UID: \"4f0101cb-a377-4ff4-b139-6c81774428ba\") " pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:10.660693 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:10.660661 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:12.122679 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:12.122642 2574 patch_prober.go:28] interesting pod/image-registry-7457b66bd4-bfzh4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:12.123107 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:12.122704 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" podUID="2f57ca73-2110-41fd-90a4-905e63f261f4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:12.462305 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:12.462271 2574 patch_prober.go:28] interesting pod/image-registry-db8dc949-5s4k9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:12.462462 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:12.462328 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podUID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:13.921296 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:13.921267 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58bf4686fb-9xb7v"] Jun 13 03:48:14.153209 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.153103 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w"] Jun 13 03:48:14.156471 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:48:14.156435 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb480708d_72d2_4632_8e70_16ab1bfd317e.slice/crio-fa577088a0f6d76006491dfd86e28dc861e45640da78a3e4e9fbd0109ee67cc9 WatchSource:0}: Error finding container fa577088a0f6d76006491dfd86e28dc861e45640da78a3e4e9fbd0109ee67cc9: Status 404 returned error can't find the container with id fa577088a0f6d76006491dfd86e28dc861e45640da78a3e4e9fbd0109ee67cc9 Jun 13 03:48:14.157997 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.157968 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-856fb87fdf-w5ft7"] Jun 13 03:48:14.160514 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:48:14.160093 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7084595e_a9cc_4aff_a602_4126c54ffaf8.slice/crio-cd1229abbc10ea4a868f498c1194a4ccd09cea8050aa97935aa7ea8217a26a7c WatchSource:0}: Error finding container cd1229abbc10ea4a868f498c1194a4ccd09cea8050aa97935aa7ea8217a26a7c: Status 404 returned error can't find the container with id cd1229abbc10ea4a868f498c1194a4ccd09cea8050aa97935aa7ea8217a26a7c Jun 13 03:48:14.160930 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.160871 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 03:48:14.163603 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:48:14.163568 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b9c71d_f47c_4761_b68d_e562d1701bb7.slice/crio-f7f85bf736afe2635291da351ad9afa53b8ad1e3d00e48b67d27383a397df3b4 WatchSource:0}: Error finding container f7f85bf736afe2635291da351ad9afa53b8ad1e3d00e48b67d27383a397df3b4: Status 404 returned error can't find the container with id f7f85bf736afe2635291da351ad9afa53b8ad1e3d00e48b67d27383a397df3b4 Jun 13 03:48:14.713266 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.713093 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-tzqjl" event={"ID":"73011311-2adb-495a-98fc-8d9bcd152ac1","Type":"ContainerStarted","Data":"bac36e998ddec4aa0121c982a619ec896024e7fba80474cb9f115cdc5e6f08b0"} Jun 13 03:48:14.713943 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.713894 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-tzqjl" Jun 13 03:48:14.716208 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.716160 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhzjp" event={"ID":"38f579ae-addd-41d7-986f-9dcd4d05b9d3","Type":"ContainerStarted","Data":"f896a8412679451275ab9462ef793cb0c9e12f8a1bf1fcc3856cdc5efbc15f2a"} Jun 13 03:48:14.719002 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.718968 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" event={"ID":"b480708d-72d2-4632-8e70-16ab1bfd317e","Type":"ContainerStarted","Data":"0ff64d7ae8fe77b8c168416ac98d04f4d7f7c3897ee62445c78be944cffaab2c"} Jun 13 03:48:14.719105 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.719031 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" event={"ID":"b480708d-72d2-4632-8e70-16ab1bfd317e","Type":"ContainerStarted","Data":"0fb707f1bbdde6deabc8398ae5a0c5ded38f65beb9275b8963d7f6da5a80a878"} Jun 13 03:48:14.719105 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.719060 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" event={"ID":"b480708d-72d2-4632-8e70-16ab1bfd317e","Type":"ContainerStarted","Data":"fa577088a0f6d76006491dfd86e28dc861e45640da78a3e4e9fbd0109ee67cc9"} Jun 13 03:48:14.721173 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.721144 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerStarted","Data":"f7f85bf736afe2635291da351ad9afa53b8ad1e3d00e48b67d27383a397df3b4"} Jun 13 03:48:14.723455 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.723432 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-tzqjl" Jun 13 03:48:14.725564 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.725485 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" event={"ID":"4f0101cb-a377-4ff4-b139-6c81774428ba","Type":"ContainerStarted","Data":"08811d3f2b221fb79030921b892ac45560b8af7c2d3a764ffc6165082de69b27"} Jun 13 03:48:14.727233 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.727181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856fb87fdf-w5ft7" event={"ID":"7084595e-a9cc-4aff-a602-4126c54ffaf8","Type":"ContainerStarted","Data":"cd1229abbc10ea4a868f498c1194a4ccd09cea8050aa97935aa7ea8217a26a7c"} Jun 13 03:48:14.747111 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:14.745955 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-tzqjl" podStartSLOduration=1.458774451 podStartE2EDuration="21.7459368s" totalImagesPullingTime="20.287162349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:14.730178311 +0000 UTC m=+246.360840902" watchObservedRunningTime="2026-06-13 03:48:14.7459368 +0000 UTC m=+246.376599391" Jun 13 03:48:15.128599 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.128008 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7597f8cbc6-zgwm7"] Jun 13 03:48:15.135117 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.134481 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.145596 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.145531 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7597f8cbc6-zgwm7"] Jun 13 03:48:15.210607 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.210232 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xhl7\" (UniqueName: \"kubernetes.io/projected/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-kube-api-access-4xhl7\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.210607 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.210288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-serving-cert\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.210607 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.210357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-oauth-config\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.210607 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.210401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-oauth-serving-cert\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.210607 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.210444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-service-ca\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.210607 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.210480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-config\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.210607 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.210507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-trusted-ca-bundle\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.313575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.311699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-config\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.313575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.311752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-trusted-ca-bundle\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.313575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.311814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xhl7\" (UniqueName: \"kubernetes.io/projected/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-kube-api-access-4xhl7\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.313575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.311857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-serving-cert\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.313575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.311914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-oauth-config\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.313575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.311957 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-oauth-serving-cert\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.313575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.312001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-service-ca\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.313575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.312856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-service-ca\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.315857 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.314908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-trusted-ca-bundle\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.315857 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.315802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-oauth-serving-cert\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.316460 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.316412 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-config\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.334436 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.320266 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-serving-cert\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.334436 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.324237 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-oauth-config\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.334436 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.327038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xhl7\" (UniqueName: \"kubernetes.io/projected/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-kube-api-access-4xhl7\") pod \"console-7597f8cbc6-zgwm7\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.463274 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.462974 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:15.641205 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.640841 2574 patch_prober.go:28] interesting pod/image-registry-db8dc949-5s4k9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:15.641205 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.640915 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podUID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:15.736153 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.735245 2574 generic.go:356] "Generic (PLEG): container finished" podID="38f579ae-addd-41d7-986f-9dcd4d05b9d3" containerID="e3dc169f902fb60dcc033757859403112eea667d89d2e35822195bbab31d8a34" exitCode=0 Jun 13 03:48:15.736438 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:15.736394 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhzjp" event={"ID":"38f579ae-addd-41d7-986f-9dcd4d05b9d3","Type":"ContainerDied","Data":"e3dc169f902fb60dcc033757859403112eea667d89d2e35822195bbab31d8a34"} Jun 13 03:48:17.138928 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:17.138882 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" podUID="2f57ca73-2110-41fd-90a4-905e63f261f4" containerName="registry" containerID="cri-o://8aeaebf8d036fccd41bd8e5cb3226a55c1aae112fc1352ed4c9886812268878a" gracePeriod=30 Jun 13 03:48:17.746712 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:17.746630 2574 generic.go:356] "Generic (PLEG): container finished" podID="2f57ca73-2110-41fd-90a4-905e63f261f4" containerID="8aeaebf8d036fccd41bd8e5cb3226a55c1aae112fc1352ed4c9886812268878a" exitCode=0 Jun 13 03:48:17.746712 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:17.746710 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" event={"ID":"2f57ca73-2110-41fd-90a4-905e63f261f4","Type":"ContainerDied","Data":"8aeaebf8d036fccd41bd8e5cb3226a55c1aae112fc1352ed4c9886812268878a"} Jun 13 03:48:19.177334 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.172753 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:48:19.226026 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.225997 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7597f8cbc6-zgwm7"] Jun 13 03:48:19.262648 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.262576 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-installation-pull-secrets\") pod \"2f57ca73-2110-41fd-90a4-905e63f261f4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " Jun 13 03:48:19.262753 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.262646 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") pod \"2f57ca73-2110-41fd-90a4-905e63f261f4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " Jun 13 03:48:19.262753 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.262675 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gmcx\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-kube-api-access-7gmcx\") pod \"2f57ca73-2110-41fd-90a4-905e63f261f4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " Jun 13 03:48:19.262753 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.262741 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f57ca73-2110-41fd-90a4-905e63f261f4-ca-trust-extracted\") pod \"2f57ca73-2110-41fd-90a4-905e63f261f4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " Jun 13 03:48:19.262908 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.262765 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-bound-sa-token\") pod \"2f57ca73-2110-41fd-90a4-905e63f261f4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " Jun 13 03:48:19.262908 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.262793 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-certificates\") pod \"2f57ca73-2110-41fd-90a4-905e63f261f4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " Jun 13 03:48:19.262908 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.262867 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-image-registry-private-configuration\") pod \"2f57ca73-2110-41fd-90a4-905e63f261f4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " Jun 13 03:48:19.262908 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.262899 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-trusted-ca\") pod \"2f57ca73-2110-41fd-90a4-905e63f261f4\" (UID: \"2f57ca73-2110-41fd-90a4-905e63f261f4\") " Jun 13 03:48:19.263453 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.263393 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2f57ca73-2110-41fd-90a4-905e63f261f4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:48:19.263616 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.263586 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2f57ca73-2110-41fd-90a4-905e63f261f4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:48:19.265538 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.265488 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2f57ca73-2110-41fd-90a4-905e63f261f4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:48:19.266838 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.266793 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2f57ca73-2110-41fd-90a4-905e63f261f4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:48:19.266838 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.266825 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2f57ca73-2110-41fd-90a4-905e63f261f4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:48:19.266960 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.266860 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2f57ca73-2110-41fd-90a4-905e63f261f4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:48:19.267142 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.267083 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-kube-api-access-7gmcx" (OuterVolumeSpecName: "kube-api-access-7gmcx") pod "2f57ca73-2110-41fd-90a4-905e63f261f4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4"). InnerVolumeSpecName "kube-api-access-7gmcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:48:19.272268 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.272239 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f57ca73-2110-41fd-90a4-905e63f261f4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2f57ca73-2110-41fd-90a4-905e63f261f4" (UID: "2f57ca73-2110-41fd-90a4-905e63f261f4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:48:19.363649 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.363625 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-image-registry-private-configuration\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:48:19.363774 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.363652 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-trusted-ca\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:48:19.363774 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.363667 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f57ca73-2110-41fd-90a4-905e63f261f4-installation-pull-secrets\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:48:19.363774 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.363680 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-tls\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:48:19.363774 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.363693 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gmcx\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-kube-api-access-7gmcx\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:48:19.363774 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.363706 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f57ca73-2110-41fd-90a4-905e63f261f4-ca-trust-extracted\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:48:19.363774 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.363718 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f57ca73-2110-41fd-90a4-905e63f261f4-bound-sa-token\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:48:19.363774 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.363731 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f57ca73-2110-41fd-90a4-905e63f261f4-registry-certificates\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:48:19.667809 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.667767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:48:19.670343 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.670315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5249c400-ac62-4edd-b111-d6529a4e672d-metrics-certs\") pod \"network-metrics-daemon-tbxdr\" (UID: \"5249c400-ac62-4edd-b111-d6529a4e672d\") " pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:48:19.746853 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.746823 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7pdj\"" Jun 13 03:48:19.754941 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.754915 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbxdr" Jun 13 03:48:19.758500 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.758466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7597f8cbc6-zgwm7" event={"ID":"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc","Type":"ContainerStarted","Data":"b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6"} Jun 13 03:48:19.758618 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.758557 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7597f8cbc6-zgwm7" event={"ID":"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc","Type":"ContainerStarted","Data":"344c8d568e4207b0653ac3a92908997f0beda4c6e8e9a30809b55a2fea6d8bec"} Jun 13 03:48:19.761088 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.761060 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" event={"ID":"b480708d-72d2-4632-8e70-16ab1bfd317e","Type":"ContainerStarted","Data":"3c9074f8714ed34b19d2fad8da207f5267edc21f82c19ac3ad33f9f33c8230c0"} Jun 13 03:48:19.763304 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.763247 2574 generic.go:356] "Generic (PLEG): container finished" podID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerID="66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22" exitCode=0 Jun 13 03:48:19.763403 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.763339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerDied","Data":"66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22"} Jun 13 03:48:19.765911 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.765888 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" event={"ID":"4f0101cb-a377-4ff4-b139-6c81774428ba","Type":"ContainerStarted","Data":"394e8e85d4781287b69db1bee2dd6e59d61112cc9c8eeb10ec3070857d95690f"} Jun 13 03:48:19.766003 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.765955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" event={"ID":"4f0101cb-a377-4ff4-b139-6c81774428ba","Type":"ContainerStarted","Data":"8af9c615956be3ec343655becd081bb2381d66fc0b2df916a90b9c753439d92a"} Jun 13 03:48:19.766060 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.766003 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" event={"ID":"4f0101cb-a377-4ff4-b139-6c81774428ba","Type":"ContainerStarted","Data":"3772ce447ec5f99554b7d019b4b15463a77060f5a09d4829ebd3f6640d3088ba"} Jun 13 03:48:19.767829 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.767798 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856fb87fdf-w5ft7" event={"ID":"7084595e-a9cc-4aff-a602-4126c54ffaf8","Type":"ContainerStarted","Data":"06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b"} Jun 13 03:48:19.770261 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.770238 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhzjp" event={"ID":"38f579ae-addd-41d7-986f-9dcd4d05b9d3","Type":"ContainerStarted","Data":"82c3d05e01c48dee78ca482afad31cd37dc87cb820772531c8b03897fad345b5"} Jun 13 03:48:19.770372 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.770285 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mhzjp" event={"ID":"38f579ae-addd-41d7-986f-9dcd4d05b9d3","Type":"ContainerStarted","Data":"d0d10ce1efd84bab343546650937e6ae5b3dc696e2a05345439673d3a981828b"} Jun 13 03:48:19.771782 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.771763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" event={"ID":"2f57ca73-2110-41fd-90a4-905e63f261f4","Type":"ContainerDied","Data":"3c7d82d2911791297e27bd9cd48f94c589c470577961690923f4af9736c86cf0"} Jun 13 03:48:19.771868 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.771812 2574 scope.go:117] "RemoveContainer" containerID="8aeaebf8d036fccd41bd8e5cb3226a55c1aae112fc1352ed4c9886812268878a" Jun 13 03:48:19.771868 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.771819 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7457b66bd4-bfzh4" Jun 13 03:48:19.776535 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.775478 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7597f8cbc6-zgwm7" podStartSLOduration=4.7754598139999995 podStartE2EDuration="4.775459814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:19.774061678 +0000 UTC m=+251.404724288" watchObservedRunningTime="2026-06-13 03:48:19.775459814 +0000 UTC m=+251.406122384" Jun 13 03:48:19.818695 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.818612 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-856fb87fdf-w5ft7" podStartSLOduration=6.614595494 podStartE2EDuration="11.818591322s" totalImagesPullingTime="5.203995828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:19.81663059 +0000 UTC m=+251.447293179" watchObservedRunningTime="2026-06-13 03:48:19.818591322 +0000 UTC m=+251.449253911" Jun 13 03:48:19.840416 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.840336 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mhzjp" podStartSLOduration=11.704911505 podStartE2EDuration="12.840314612s" totalImagesPullingTime="1.036462523s" totalInitContainerRuntime="98.940584ms" isStatefulPod=true podCreationTimestamp="2026-06-13 03:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:19.838474225 +0000 UTC m=+251.469136815" watchObservedRunningTime="2026-06-13 03:48:19.840314612 +0000 UTC m=+251.470977201" Jun 13 03:48:19.883909 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.883342 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-k2q9w" podStartSLOduration=8.164148622999999 podStartE2EDuration="12.883319422s" totalImagesPullingTime="4.719170799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:19.858758198 +0000 UTC m=+251.489420830" watchObservedRunningTime="2026-06-13 03:48:19.883319422 +0000 UTC m=+251.513982058" Jun 13 03:48:19.884803 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.884758 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7457b66bd4-bfzh4"] Jun 13 03:48:19.888065 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.888044 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7457b66bd4-bfzh4"] Jun 13 03:48:19.914271 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:19.914223 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbxdr"] Jun 13 03:48:19.917265 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:48:19.917236 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5249c400_ac62_4edd_b111_d6529a4e672d.slice/crio-4241638c7590f5d4e074d3e9f5d6282f5095a2f9a82fb1ba9914f4e7edbdcde5 WatchSource:0}: Error finding container 4241638c7590f5d4e074d3e9f5d6282f5095a2f9a82fb1ba9914f4e7edbdcde5: Status 404 returned error can't find the container with id 4241638c7590f5d4e074d3e9f5d6282f5095a2f9a82fb1ba9914f4e7edbdcde5 Jun 13 03:48:20.778023 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:20.777984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbxdr" event={"ID":"5249c400-ac62-4edd-b111-d6529a4e672d","Type":"ContainerStarted","Data":"4241638c7590f5d4e074d3e9f5d6282f5095a2f9a82fb1ba9914f4e7edbdcde5"} Jun 13 03:48:20.856944 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:20.856905 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f57ca73-2110-41fd-90a4-905e63f261f4" path="/var/lib/kubelet/pods/2f57ca73-2110-41fd-90a4-905e63f261f4/volumes" Jun 13 03:48:22.462101 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.462068 2574 patch_prober.go:28] interesting pod/image-registry-db8dc949-5s4k9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:22.462560 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.462117 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podUID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:22.792248 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.792215 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbxdr" event={"ID":"5249c400-ac62-4edd-b111-d6529a4e672d","Type":"ContainerStarted","Data":"ce101fb69e20ee599f8250c623a29a767040873ab6362d318f0bab479a7c38a7"} Jun 13 03:48:22.792354 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.792273 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbxdr" event={"ID":"5249c400-ac62-4edd-b111-d6529a4e672d","Type":"ContainerStarted","Data":"5c4dd9d7492402714ed8529da2ba7a2f7ee68ebb0cd0e66167d09f6bfbeb172f"} Jun 13 03:48:22.794888 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.794864 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerStarted","Data":"88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60"} Jun 13 03:48:22.798639 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.798613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" event={"ID":"4f0101cb-a377-4ff4-b139-6c81774428ba","Type":"ContainerStarted","Data":"84d1943bd802e2f9b47df31147e89ebbc202a275098f303647995a0628f01edb"} Jun 13 03:48:22.798758 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.798682 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" event={"ID":"4f0101cb-a377-4ff4-b139-6c81774428ba","Type":"ContainerStarted","Data":"4d47cb33f6f837382cdb50361e5fe32c2e11b4adcc1c1caa475f18e01659c004"} Jun 13 03:48:22.798758 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.798724 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" event={"ID":"4f0101cb-a377-4ff4-b139-6c81774428ba","Type":"ContainerStarted","Data":"bee5aa5c0ed48c193174b0bb97e8e8da091d23ee5bb00a4dac67daf034576b60"} Jun 13 03:48:22.798870 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.798799 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:22.808508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.808465 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tbxdr" podStartSLOduration=251.663496712 podStartE2EDuration="4m13.808452281s" totalImagesPullingTime="2.144955569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:22.807009262 +0000 UTC m=+254.437671852" watchObservedRunningTime="2026-06-13 03:48:22.808452281 +0000 UTC m=+254.439114869" Jun 13 03:48:22.828281 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:22.828213 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" podStartSLOduration=5.247379426 podStartE2EDuration="12.828199022s" totalImagesPullingTime="7.580819596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:48:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:22.826865198 +0000 UTC m=+254.457527805" watchObservedRunningTime="2026-06-13 03:48:22.828199022 +0000 UTC m=+254.458861613" Jun 13 03:48:23.811233 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:23.811195 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerStarted","Data":"71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0"} Jun 13 03:48:23.811716 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:23.811298 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerStarted","Data":"19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c"} Jun 13 03:48:23.811716 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:23.811334 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerStarted","Data":"8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964"} Jun 13 03:48:23.811716 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:23.811382 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerStarted","Data":"2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6"} Jun 13 03:48:23.811716 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:23.811420 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerStarted","Data":"bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b"} Jun 13 03:48:23.834993 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:23.834952 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.19072659 podStartE2EDuration="15.834938653s" totalImagesPullingTime="7.621134898s" totalInitContainerRuntime="23.077165ms" isStatefulPod=false podCreationTimestamp="2026-06-13 03:48:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:23.833211497 +0000 UTC m=+255.463874086" watchObservedRunningTime="2026-06-13 03:48:23.834938653 +0000 UTC m=+255.465601267" Jun 13 03:48:25.463773 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:25.463695 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:25.463773 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:25.463765 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:48:25.465065 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:25.465041 2574 patch_prober.go:28] interesting pod/console-7597f8cbc6-zgwm7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 13 03:48:25.465179 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:25.465083 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7597f8cbc6-zgwm7" podUID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 13 03:48:25.638978 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:25.638947 2574 patch_prober.go:28] interesting pod/image-registry-db8dc949-5s4k9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:25.639208 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:25.638993 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podUID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:28.801154 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:28.801109 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:28.801611 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:28.801176 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:48:28.802587 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:28.802561 2574 patch_prober.go:28] interesting pod/console-856fb87fdf-w5ft7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jun 13 03:48:28.802690 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:28.802601 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-856fb87fdf-w5ft7" podUID="7084595e-a9cc-4aff-a602-4126c54ffaf8" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jun 13 03:48:28.816033 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:28.816014 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58bf4686fb-9xb7v" Jun 13 03:48:32.460695 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:32.460665 2574 patch_prober.go:28] interesting pod/image-registry-db8dc949-5s4k9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:32.461158 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:32.460710 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podUID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:32.461158 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:32.460746 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:48:32.461239 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:32.461183 2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"89162b3949641815462e1f770063cc46776bfa181a4190c51482c218987428eb"} pod="openshift-image-registry/image-registry-db8dc949-5s4k9" containerMessage="Container registry failed liveness probe, will be restarted" Jun 13 03:48:32.464731 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:32.464703 2574 patch_prober.go:28] interesting pod/image-registry-db8dc949-5s4k9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:32.464854 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:32.464768 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podUID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:35.463997 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:35.463964 2574 patch_prober.go:28] interesting pod/console-7597f8cbc6-zgwm7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 13 03:48:35.464369 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:35.464014 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7597f8cbc6-zgwm7" podUID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 13 03:48:38.801836 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:38.801803 2574 patch_prober.go:28] interesting pod/console-856fb87fdf-w5ft7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jun 13 03:48:38.802283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:38.801859 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-856fb87fdf-w5ft7" podUID="7084595e-a9cc-4aff-a602-4126c54ffaf8" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jun 13 03:48:42.465237 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:42.465203 2574 patch_prober.go:28] interesting pod/image-registry-db8dc949-5s4k9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:42.465593 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:42.465251 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podUID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:45.463791 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:45.463754 2574 patch_prober.go:28] interesting pod/console-7597f8cbc6-zgwm7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 13 03:48:45.464263 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:45.463806 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7597f8cbc6-zgwm7" podUID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 13 03:48:48.801569 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:48.801536 2574 patch_prober.go:28] interesting pod/console-856fb87fdf-w5ft7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jun 13 03:48:48.801933 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:48.801578 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-856fb87fdf-w5ft7" podUID="7084595e-a9cc-4aff-a602-4126c54ffaf8" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jun 13 03:48:49.408629 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:48:49.408593 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xp674" podUID="934bab98-9352-4baf-a814-242cadd9cbba" Jun 13 03:48:49.908425 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:49.908393 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xp674" Jun 13 03:48:52.464874 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:52.464838 2574 patch_prober.go:28] interesting pod/image-registry-db8dc949-5s4k9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:48:52.465240 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:52.464898 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podUID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:48:53.234965 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:53.234934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:48:53.237192 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:53.237164 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/934bab98-9352-4baf-a814-242cadd9cbba-metrics-tls\") pod \"dns-default-xp674\" (UID: \"934bab98-9352-4baf-a814-242cadd9cbba\") " pod="openshift-dns/dns-default-xp674" Jun 13 03:48:53.511503 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:53.511430 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-stzhf\"" Jun 13 03:48:53.519591 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:53.519574 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xp674" Jun 13 03:48:53.691571 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:53.691547 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xp674"] Jun 13 03:48:53.693793 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:48:53.693754 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934bab98_9352_4baf_a814_242cadd9cbba.slice/crio-07cf8b98887c40ae4e31946ec11efcd699e0ab078e9974f26739ce911250b524 WatchSource:0}: Error finding container 07cf8b98887c40ae4e31946ec11efcd699e0ab078e9974f26739ce911250b524: Status 404 returned error can't find the container with id 07cf8b98887c40ae4e31946ec11efcd699e0ab078e9974f26739ce911250b524 Jun 13 03:48:53.928913 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:53.928825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xp674" event={"ID":"934bab98-9352-4baf-a814-242cadd9cbba","Type":"ContainerStarted","Data":"07cf8b98887c40ae4e31946ec11efcd699e0ab078e9974f26739ce911250b524"} Jun 13 03:48:55.464503 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:55.464470 2574 patch_prober.go:28] interesting pod/console-7597f8cbc6-zgwm7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 13 03:48:55.464926 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:55.464515 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7597f8cbc6-zgwm7" podUID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 13 03:48:55.939043 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:55.939009 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xp674" event={"ID":"934bab98-9352-4baf-a814-242cadd9cbba","Type":"ContainerStarted","Data":"9f71e23c8ad5da92bcad32d6805edab3485873033c6874aa998fae4a182f2a77"} Jun 13 03:48:55.939184 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:55.939060 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xp674" event={"ID":"934bab98-9352-4baf-a814-242cadd9cbba","Type":"ContainerStarted","Data":"4f25a669d4b9b7eb249ade98e608f50574e80080bb0d4e95ac500472118d14a2"} Jun 13 03:48:55.939184 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:55.939108 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xp674" Jun 13 03:48:55.955944 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:55.955905 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xp674" podStartSLOduration=251.07038913 podStartE2EDuration="4m12.955890984s" totalImagesPullingTime="1.885501854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:55.954182782 +0000 UTC m=+287.584845365" watchObservedRunningTime="2026-06-13 03:48:55.955890984 +0000 UTC m=+287.586553619" Jun 13 03:48:57.480241 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:57.480198 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" podUID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerName="registry" containerID="cri-o://89162b3949641815462e1f770063cc46776bfa181a4190c51482c218987428eb" gracePeriod=30 Jun 13 03:48:58.801588 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:58.801506 2574 patch_prober.go:28] interesting pod/console-856fb87fdf-w5ft7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jun 13 03:48:58.801588 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:58.801565 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-856fb87fdf-w5ft7" podUID="7084595e-a9cc-4aff-a602-4126c54ffaf8" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jun 13 03:48:58.954010 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:58.953979 2574 generic.go:356] "Generic (PLEG): container finished" podID="323d7022-5268-4c98-b8be-b67c1cfbb854" containerID="89162b3949641815462e1f770063cc46776bfa181a4190c51482c218987428eb" exitCode=0 Jun 13 03:48:58.954188 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:58.954042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" event={"ID":"323d7022-5268-4c98-b8be-b67c1cfbb854","Type":"ContainerDied","Data":"89162b3949641815462e1f770063cc46776bfa181a4190c51482c218987428eb"} Jun 13 03:48:58.954188 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:58.954083 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" event={"ID":"323d7022-5268-4c98-b8be-b67c1cfbb854","Type":"ContainerStarted","Data":"832934f381995d382f3265945cf475299207803da720e5942de9fddc676be304"} Jun 13 03:48:58.954277 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:48:58.954259 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:49:02.569630 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:02.569596 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9b9c71d-f47c-4761-b68d-e562d1701bb7/init-config-reloader/0.log" Jun 13 03:49:02.769617 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:02.769591 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9b9c71d-f47c-4761-b68d-e562d1701bb7/alertmanager/0.log" Jun 13 03:49:02.969775 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:02.969747 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9b9c71d-f47c-4761-b68d-e562d1701bb7/config-reloader/0.log" Jun 13 03:49:03.168925 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:03.168894 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9b9c71d-f47c-4761-b68d-e562d1701bb7/kube-rbac-proxy-web/0.log" Jun 13 03:49:03.369413 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:03.369343 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9b9c71d-f47c-4761-b68d-e562d1701bb7/kube-rbac-proxy/0.log" Jun 13 03:49:03.569301 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:03.569272 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9b9c71d-f47c-4761-b68d-e562d1701bb7/kube-rbac-proxy-metric/0.log" Jun 13 03:49:03.769355 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:03.769333 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9b9c71d-f47c-4761-b68d-e562d1701bb7/prom-label-proxy/0.log" Jun 13 03:49:05.468303 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:05.468278 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:49:05.472119 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:05.472086 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:49:05.520654 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:05.520622 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-856fb87fdf-w5ft7"] Jun 13 03:49:05.944917 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:05.944892 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xp674" Jun 13 03:49:06.369228 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:06.369149 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhzjp_38f579ae-addd-41d7-986f-9dcd4d05b9d3/init-textfile/0.log" Jun 13 03:49:06.570641 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:06.570614 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhzjp_38f579ae-addd-41d7-986f-9dcd4d05b9d3/node-exporter/0.log" Jun 13 03:49:06.769251 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:06.769228 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhzjp_38f579ae-addd-41d7-986f-9dcd4d05b9d3/kube-rbac-proxy/0.log" Jun 13 03:49:06.969274 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:06.969247 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-k2q9w_b480708d-72d2-4632-8e70-16ab1bfd317e/kube-rbac-proxy-main/0.log" Jun 13 03:49:07.169606 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:07.169533 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-k2q9w_b480708d-72d2-4632-8e70-16ab1bfd317e/kube-rbac-proxy-self/0.log" Jun 13 03:49:07.369109 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:07.369079 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-k2q9w_b480708d-72d2-4632-8e70-16ab1bfd317e/openshift-state-metrics/0.log" Jun 13 03:49:08.796997 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:08.796974 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 03:49:08.798033 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:08.798012 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 03:49:08.807946 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:08.807930 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 03:49:09.569540 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:09.569512 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/thanos-query/0.log" Jun 13 03:49:09.769704 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:09.769672 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/kube-rbac-proxy-web/0.log" Jun 13 03:49:09.968888 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:09.968864 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/kube-rbac-proxy/0.log" Jun 13 03:49:10.169885 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:10.169854 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/prom-label-proxy/0.log" Jun 13 03:49:10.369269 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:10.369178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/kube-rbac-proxy-rules/0.log" Jun 13 03:49:10.569221 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:10.569184 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/kube-rbac-proxy-metrics/0.log" Jun 13 03:49:10.768986 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:10.768964 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-8pcb5_0b47462a-ec83-49b8-af0a-e5a3dac8866c/networking-console-plugin/0.log" Jun 13 03:49:10.969006 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:10.968981 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 03:49:11.172272 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:11.172189 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/2.log" Jun 13 03:49:11.371815 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:11.371785 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7597f8cbc6-zgwm7_30f832aa-cb8c-49ea-ab75-7ad53e7d97fc/console/0.log" Jun 13 03:49:11.570057 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:11.570029 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-856fb87fdf-w5ft7_7084595e-a9cc-4aff-a602-4126c54ffaf8/console/0.log" Jun 13 03:49:11.771921 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:11.771885 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-tzqjl_73011311-2adb-495a-98fc-8d9bcd152ac1/download-server/0.log" Jun 13 03:49:12.769412 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:12.769386 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xp674_934bab98-9352-4baf-a814-242cadd9cbba/dns/0.log" Jun 13 03:49:12.970383 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:12.970357 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xp674_934bab98-9352-4baf-a814-242cadd9cbba/kube-rbac-proxy/0.log" Jun 13 03:49:13.169086 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:13.169013 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hprjm_05ed7d04-f583-4e9a-8acb-74a8411da301/dns-node-resolver/0.log" Jun 13 03:49:13.970250 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:13.970224 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-db8dc949-5s4k9_323d7022-5268-4c98-b8be-b67c1cfbb854/registry/0.log" Jun 13 03:49:14.168914 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:14.168888 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-db8dc949-5s4k9_323d7022-5268-4c98-b8be-b67c1cfbb854/registry/1.log" Jun 13 03:49:14.370329 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:14.370252 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdtxs_d873938a-d1bf-4847-a272-c8a9ef0cd6ad/node-ca/0.log" Jun 13 03:49:15.569138 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:15.569102 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kch4f_bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a/serve-healthcheck-canary/0.log" Jun 13 03:49:19.962272 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:19.962242 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-db8dc949-5s4k9" Jun 13 03:49:27.642913 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:27.642877 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 03:49:27.643434 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:27.643179 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="alertmanager" containerID="cri-o://88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60" gracePeriod=120 Jun 13 03:49:27.643434 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:27.643254 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy-metric" containerID="cri-o://19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c" gracePeriod=120 Jun 13 03:49:27.643434 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:27.643277 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="config-reloader" containerID="cri-o://bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b" gracePeriod=120 Jun 13 03:49:27.643434 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:27.643331 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="prom-label-proxy" containerID="cri-o://71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0" gracePeriod=120 Jun 13 03:49:27.643434 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:27.643288 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy" containerID="cri-o://8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964" gracePeriod=120 Jun 13 03:49:27.643434 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:27.643293 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy-web" containerID="cri-o://2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6" gracePeriod=120 Jun 13 03:49:28.074346 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074322 2574 generic.go:356] "Generic (PLEG): container finished" podID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerID="71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0" exitCode=0 Jun 13 03:49:28.074346 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074343 2574 generic.go:356] "Generic (PLEG): container finished" podID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerID="19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c" exitCode=0 Jun 13 03:49:28.074497 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074350 2574 generic.go:356] "Generic (PLEG): container finished" podID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerID="8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964" exitCode=0 Jun 13 03:49:28.074497 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074355 2574 generic.go:356] "Generic (PLEG): container finished" podID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerID="bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b" exitCode=0 Jun 13 03:49:28.074497 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074361 2574 generic.go:356] "Generic (PLEG): container finished" podID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerID="88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60" exitCode=0 Jun 13 03:49:28.074497 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074393 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerDied","Data":"71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0"} Jun 13 03:49:28.074497 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074450 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerDied","Data":"19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c"} Jun 13 03:49:28.074497 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074476 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerDied","Data":"8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964"} Jun 13 03:49:28.074497 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074499 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerDied","Data":"bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b"} Jun 13 03:49:28.074703 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.074521 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerDied","Data":"88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60"} Jun 13 03:49:28.882250 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:28.882227 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.027067 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.026995 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-cluster-tls-config\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027067 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027033 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-web-config\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027067 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027057 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-out\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027342 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027087 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-web\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027342 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027107 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-metrics-client-ca\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027342 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027140 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027342 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027158 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027342 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027195 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027606 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027552 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:49:29.027724 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027699 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8fcn\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-kube-api-access-f8fcn\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027838 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027822 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-volume\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.027954 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.027939 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-trusted-ca-bundle\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.028069 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.028057 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-main-db\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.028199 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.028184 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-tls-assets\") pod \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\" (UID: \"e9b9c71d-f47c-4761-b68d-e562d1701bb7\") " Jun 13 03:49:29.028563 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.028543 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-metrics-client-ca\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.030154 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.029980 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:29.030401 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.030310 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-out" (OuterVolumeSpecName: "config-out") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:49:29.030401 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.030354 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:29.030554 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.030484 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:29.030679 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.030630 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:29.030896 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.030866 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:49:29.030972 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.030938 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:49:29.031912 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.031893 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-volume" (OuterVolumeSpecName: "config-volume") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:29.031995 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.031959 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:49:29.032522 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.032506 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-kube-api-access-f8fcn" (OuterVolumeSpecName: "kube-api-access-f8fcn") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "kube-api-access-f8fcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:49:29.034621 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.034590 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:29.041218 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.041198 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-web-config" (OuterVolumeSpecName: "web-config") pod "e9b9c71d-f47c-4761-b68d-e562d1701bb7" (UID: "e9b9c71d-f47c-4761-b68d-e562d1701bb7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:29.081665 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.081636 2574 generic.go:356] "Generic (PLEG): container finished" podID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerID="2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6" exitCode=0 Jun 13 03:49:29.081746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.081697 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerDied","Data":"2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6"} Jun 13 03:49:29.081746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.081740 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.081813 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.081799 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9b9c71d-f47c-4761-b68d-e562d1701bb7","Type":"ContainerDied","Data":"f7f85bf736afe2635291da351ad9afa53b8ad1e3d00e48b67d27383a397df3b4"} Jun 13 03:49:29.081859 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.081847 2574 scope.go:117] "RemoveContainer" containerID="71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0" Jun 13 03:49:29.089429 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.089406 2574 scope.go:117] "RemoveContainer" containerID="19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c" Jun 13 03:49:29.096568 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.096549 2574 scope.go:117] "RemoveContainer" containerID="8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964" Jun 13 03:49:29.103421 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.103401 2574 scope.go:117] "RemoveContainer" containerID="2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6" Jun 13 03:49:29.105512 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.105492 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 03:49:29.110345 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.110246 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 03:49:29.110403 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.110370 2574 scope.go:117] "RemoveContainer" containerID="bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b" Jun 13 03:49:29.116856 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.116833 2574 scope.go:117] "RemoveContainer" containerID="88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60" Jun 13 03:49:29.123401 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.123385 2574 scope.go:117] "RemoveContainer" containerID="66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22" Jun 13 03:49:29.129600 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129581 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-out\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129600 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129611 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129623 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129633 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-secret-alertmanager-main-tls\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129641 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8fcn\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-kube-api-access-f8fcn\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129649 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-config-volume\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129657 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129665 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9b9c71d-f47c-4761-b68d-e562d1701bb7-alertmanager-main-db\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129674 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9b9c71d-f47c-4761-b68d-e562d1701bb7-tls-assets\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129983 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129682 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-cluster-tls-config\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129983 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129690 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9b9c71d-f47c-4761-b68d-e562d1701bb7-web-config\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:29.129983 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.129867 2574 scope.go:117] "RemoveContainer" containerID="71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0" Jun 13 03:49:29.130186 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:49:29.130143 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0\": container with ID starting with 71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0 not found: ID does not exist" containerID="71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0" Jun 13 03:49:29.130186 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.130163 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0"} err="failed to get container status \"71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0\": rpc error: code = NotFound desc = could not find container \"71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0\": container with ID starting with 71c8fabf839380dc6a3bed192b05bfe3f19707897ca0ca6e0d26dc9b540228b0 not found: ID does not exist" Jun 13 03:49:29.130186 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.130179 2574 scope.go:117] "RemoveContainer" containerID="19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c" Jun 13 03:49:29.130386 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:49:29.130371 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c\": container with ID starting with 19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c not found: ID does not exist" containerID="19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c" Jun 13 03:49:29.130426 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.130389 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c"} err="failed to get container status \"19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c\": rpc error: code = NotFound desc = could not find container \"19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c\": container with ID starting with 19e2256f125a2ad281962c7fa1a4f59310e4c88e78e0a411291b215f023c282c not found: ID does not exist" Jun 13 03:49:29.130426 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.130401 2574 scope.go:117] "RemoveContainer" containerID="8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964" Jun 13 03:49:29.130608 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:49:29.130591 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964\": container with ID starting with 8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964 not found: ID does not exist" containerID="8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964" Jun 13 03:49:29.130656 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.130610 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964"} err="failed to get container status \"8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964\": rpc error: code = NotFound desc = could not find container \"8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964\": container with ID starting with 8d89e398fc7a61cb1678a73a14b2757969b1e6ea5b7f282f11db67eb867ed964 not found: ID does not exist" Jun 13 03:49:29.130656 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.130624 2574 scope.go:117] "RemoveContainer" containerID="2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6" Jun 13 03:49:29.130825 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:49:29.130811 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6\": container with ID starting with 2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6 not found: ID does not exist" containerID="2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6" Jun 13 03:49:29.130870 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.130829 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6"} err="failed to get container status \"2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6\": rpc error: code = NotFound desc = could not find container \"2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6\": container with ID starting with 2d2da25983c80ce4891a7f9bb3e67c68b00decbab36c9bcb16c1498d03e5b8e6 not found: ID does not exist" Jun 13 03:49:29.130870 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.130841 2574 scope.go:117] "RemoveContainer" containerID="bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b" Jun 13 03:49:29.131039 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:49:29.131024 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b\": container with ID starting with bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b not found: ID does not exist" containerID="bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b" Jun 13 03:49:29.131077 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.131041 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b"} err="failed to get container status \"bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b\": rpc error: code = NotFound desc = could not find container \"bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b\": container with ID starting with bb0e31e445734a0cf8c6123a474ea33495c1b3863101b31450f64213949cbb5b not found: ID does not exist" Jun 13 03:49:29.131077 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.131052 2574 scope.go:117] "RemoveContainer" containerID="88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60" Jun 13 03:49:29.131408 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:49:29.131381 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60\": container with ID starting with 88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60 not found: ID does not exist" containerID="88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60" Jun 13 03:49:29.131518 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.131413 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60"} err="failed to get container status \"88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60\": rpc error: code = NotFound desc = could not find container \"88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60\": container with ID starting with 88c654cdee54f444cf30645b66638d4a159c36c7561b207fae1fbe5ba764fb60 not found: ID does not exist" Jun 13 03:49:29.131518 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.131432 2574 scope.go:117] "RemoveContainer" containerID="66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22" Jun 13 03:49:29.131723 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:49:29.131706 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22\": container with ID starting with 66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22 not found: ID does not exist" containerID="66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22" Jun 13 03:49:29.131778 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.131728 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22"} err="failed to get container status \"66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22\": rpc error: code = NotFound desc = could not find container \"66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22\": container with ID starting with 66aeed9d3a9b79f448339af5155cdd96681fc7513e615fc2d6914568fba79a22 not found: ID does not exist" Jun 13 03:49:29.132930 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.132913 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 03:49:29.133240 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133227 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="config-reloader" Jun 13 03:49:29.133283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133242 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="config-reloader" Jun 13 03:49:29.133283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133250 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="init-config-reloader" Jun 13 03:49:29.133283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133257 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="init-config-reloader" Jun 13 03:49:29.133283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133263 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="alertmanager" Jun 13 03:49:29.133283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133268 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="alertmanager" Jun 13 03:49:29.133283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133274 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="prom-label-proxy" Jun 13 03:49:29.133283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133279 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="prom-label-proxy" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133286 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f57ca73-2110-41fd-90a4-905e63f261f4" containerName="registry" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133291 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f57ca73-2110-41fd-90a4-905e63f261f4" containerName="registry" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133299 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133305 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133315 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy-web" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133320 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy-web" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133327 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy-metric" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133332 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy-metric" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133387 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="config-reloader" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133395 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="prom-label-proxy" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133401 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133409 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="alertmanager" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133415 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy-metric" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133421 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" containerName="kube-rbac-proxy-web" Jun 13 03:49:29.133488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.133426 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f57ca73-2110-41fd-90a4-905e63f261f4" containerName="registry" Jun 13 03:49:29.136555 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.136540 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.139355 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.139335 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 03:49:29.139434 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.139382 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 03:49:29.139434 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.139421 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 03:49:29.139519 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.139428 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7hqjk\"" Jun 13 03:49:29.139562 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.139518 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 03:49:29.139562 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.139554 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 03:49:29.139771 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.139755 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 03:49:29.139812 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.139791 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 03:49:29.139990 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.139976 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 03:49:29.144220 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.144202 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 03:49:29.150419 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.150399 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 03:49:29.230331 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230299 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230493 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-config-out\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230493 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230493 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230657 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230657 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230657 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230657 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-config-volume\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230657 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230929 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-web-config\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230929 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230929 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tp6q\" (UniqueName: \"kubernetes.io/projected/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-kube-api-access-4tp6q\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.230929 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.230807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332042 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.331951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-config-out\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332042 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.331995 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332042 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332331 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332059 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332331 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332331 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332331 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-config-volume\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332542 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332542 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-web-config\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332542 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332542 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tp6q\" (UniqueName: \"kubernetes.io/projected/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-kube-api-access-4tp6q\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332542 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332786 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.332859 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.332838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.334243 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.333088 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.334243 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.333454 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.335032 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.334962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-config-out\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.335032 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.334969 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.335208 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.335043 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.335208 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.335074 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-config-volume\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.335306 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.335290 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.335358 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.335339 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.335576 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.335559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.335982 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.335958 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.336839 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.336822 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-web-config\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.341114 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.341093 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tp6q\" (UniqueName: \"kubernetes.io/projected/30ba7379-a88a-4393-ae8f-2ab049d5dbe5-kube-api-access-4tp6q\") pod \"alertmanager-main-0\" (UID: \"30ba7379-a88a-4393-ae8f-2ab049d5dbe5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.446455 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.446432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 03:49:29.576355 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:29.576331 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 03:49:29.578085 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:49:29.578062 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ba7379_a88a_4393_ae8f_2ab049d5dbe5.slice/crio-21dc925cb94c0bfa837e04e1c109aa74fb66f0a3a60197984a0b03bbe0cacdf4 WatchSource:0}: Error finding container 21dc925cb94c0bfa837e04e1c109aa74fb66f0a3a60197984a0b03bbe0cacdf4: Status 404 returned error can't find the container with id 21dc925cb94c0bfa837e04e1c109aa74fb66f0a3a60197984a0b03bbe0cacdf4 Jun 13 03:49:30.087691 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.087663 2574 generic.go:356] "Generic (PLEG): container finished" podID="30ba7379-a88a-4393-ae8f-2ab049d5dbe5" containerID="85cee64ed7ef072e84d56f95e3106efcced875157a000dbef950603dda09471a" exitCode=0 Jun 13 03:49:30.088038 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.087709 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30ba7379-a88a-4393-ae8f-2ab049d5dbe5","Type":"ContainerDied","Data":"85cee64ed7ef072e84d56f95e3106efcced875157a000dbef950603dda09471a"} Jun 13 03:49:30.088038 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.087758 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30ba7379-a88a-4393-ae8f-2ab049d5dbe5","Type":"ContainerStarted","Data":"21dc925cb94c0bfa837e04e1c109aa74fb66f0a3a60197984a0b03bbe0cacdf4"} Jun 13 03:49:30.546775 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.546711 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-856fb87fdf-w5ft7" podUID="7084595e-a9cc-4aff-a602-4126c54ffaf8" containerName="console" containerID="cri-o://06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b" gracePeriod=15 Jun 13 03:49:30.791116 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.791083 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:49:30.848701 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.848670 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9b9c71d-f47c-4761-b68d-e562d1701bb7" path="/var/lib/kubelet/pods/e9b9c71d-f47c-4761-b68d-e562d1701bb7/volumes" Jun 13 03:49:30.949346 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949326 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-config\") pod \"7084595e-a9cc-4aff-a602-4126c54ffaf8\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " Jun 13 03:49:30.949482 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949361 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-service-ca\") pod \"7084595e-a9cc-4aff-a602-4126c54ffaf8\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " Jun 13 03:49:30.949482 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949403 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-trusted-ca-bundle\") pod \"7084595e-a9cc-4aff-a602-4126c54ffaf8\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " Jun 13 03:49:30.949482 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949430 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-serving-cert\") pod \"7084595e-a9cc-4aff-a602-4126c54ffaf8\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " Jun 13 03:49:30.949482 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949454 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-oauth-config\") pod \"7084595e-a9cc-4aff-a602-4126c54ffaf8\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " Jun 13 03:49:30.949482 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949476 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvk2f\" (UniqueName: \"kubernetes.io/projected/7084595e-a9cc-4aff-a602-4126c54ffaf8-kube-api-access-qvk2f\") pod \"7084595e-a9cc-4aff-a602-4126c54ffaf8\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " Jun 13 03:49:30.949729 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949602 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-oauth-serving-cert\") pod \"7084595e-a9cc-4aff-a602-4126c54ffaf8\" (UID: \"7084595e-a9cc-4aff-a602-4126c54ffaf8\") " Jun 13 03:49:30.949783 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949753 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-config" (OuterVolumeSpecName: "console-config") pod "7084595e-a9cc-4aff-a602-4126c54ffaf8" (UID: "7084595e-a9cc-4aff-a602-4126c54ffaf8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:49:30.949908 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949879 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7084595e-a9cc-4aff-a602-4126c54ffaf8" (UID: "7084595e-a9cc-4aff-a602-4126c54ffaf8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:49:30.950002 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.949922 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-service-ca" (OuterVolumeSpecName: "service-ca") pod "7084595e-a9cc-4aff-a602-4126c54ffaf8" (UID: "7084595e-a9cc-4aff-a602-4126c54ffaf8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:49:30.950059 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.950035 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7084595e-a9cc-4aff-a602-4126c54ffaf8" (UID: "7084595e-a9cc-4aff-a602-4126c54ffaf8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:49:30.950467 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.950362 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-oauth-serving-cert\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:30.950467 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.950385 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-config\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:30.950467 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.950401 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-service-ca\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:30.950467 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.950429 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084595e-a9cc-4aff-a602-4126c54ffaf8-trusted-ca-bundle\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:30.951819 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.951796 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7084595e-a9cc-4aff-a602-4126c54ffaf8-kube-api-access-qvk2f" (OuterVolumeSpecName: "kube-api-access-qvk2f") pod "7084595e-a9cc-4aff-a602-4126c54ffaf8" (UID: "7084595e-a9cc-4aff-a602-4126c54ffaf8"). InnerVolumeSpecName "kube-api-access-qvk2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:49:30.951905 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.951826 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7084595e-a9cc-4aff-a602-4126c54ffaf8" (UID: "7084595e-a9cc-4aff-a602-4126c54ffaf8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:30.951905 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:30.951850 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7084595e-a9cc-4aff-a602-4126c54ffaf8" (UID: "7084595e-a9cc-4aff-a602-4126c54ffaf8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:31.050973 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.050950 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-serving-cert\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:31.050973 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.050971 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7084595e-a9cc-4aff-a602-4126c54ffaf8-console-oauth-config\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:31.051095 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.050980 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvk2f\" (UniqueName: \"kubernetes.io/projected/7084595e-a9cc-4aff-a602-4126c54ffaf8-kube-api-access-qvk2f\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:49:31.092981 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.092949 2574 generic.go:356] "Generic (PLEG): container finished" podID="7084595e-a9cc-4aff-a602-4126c54ffaf8" containerID="06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b" exitCode=0 Jun 13 03:49:31.093339 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.092997 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-856fb87fdf-w5ft7" Jun 13 03:49:31.093339 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.093029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856fb87fdf-w5ft7" event={"ID":"7084595e-a9cc-4aff-a602-4126c54ffaf8","Type":"ContainerDied","Data":"06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b"} Jun 13 03:49:31.093339 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.093075 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-856fb87fdf-w5ft7" event={"ID":"7084595e-a9cc-4aff-a602-4126c54ffaf8","Type":"ContainerDied","Data":"cd1229abbc10ea4a868f498c1194a4ccd09cea8050aa97935aa7ea8217a26a7c"} Jun 13 03:49:31.093339 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.093104 2574 scope.go:117] "RemoveContainer" containerID="06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b" Jun 13 03:49:31.096429 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.096409 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30ba7379-a88a-4393-ae8f-2ab049d5dbe5","Type":"ContainerStarted","Data":"cbccf30aa6150355f1b825bf0344ca218468cc77599b1e5f81d6471de826b14d"} Jun 13 03:49:31.096526 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.096464 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30ba7379-a88a-4393-ae8f-2ab049d5dbe5","Type":"ContainerStarted","Data":"10d027de45c489d94aaa8cfe1b863db08cea997e847c820642f110f81dda27d3"} Jun 13 03:49:31.096526 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.096495 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30ba7379-a88a-4393-ae8f-2ab049d5dbe5","Type":"ContainerStarted","Data":"9dec083d1822e3b8e05020b722cd28310c962a388f28a9ddd264a120e622c258"} Jun 13 03:49:31.096526 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.096518 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30ba7379-a88a-4393-ae8f-2ab049d5dbe5","Type":"ContainerStarted","Data":"010c62b6f4a471de66474682b0179c4c12d1ae24ef7ee24f9c526ea82233c3f8"} Jun 13 03:49:31.096675 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.096552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30ba7379-a88a-4393-ae8f-2ab049d5dbe5","Type":"ContainerStarted","Data":"c2d8c7aa95390f224e547daeafe1bb31b65888560fec83cd756283ea32ce7c69"} Jun 13 03:49:31.096675 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.096582 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"30ba7379-a88a-4393-ae8f-2ab049d5dbe5","Type":"ContainerStarted","Data":"72754f9526274c8e5f300ddd50d33d9b424a2cca735ad288af6b79ac426e9c92"} Jun 13 03:49:31.102602 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.102586 2574 scope.go:117] "RemoveContainer" containerID="06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b" Jun 13 03:49:31.102839 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:49:31.102821 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b\": container with ID starting with 06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b not found: ID does not exist" containerID="06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b" Jun 13 03:49:31.102901 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.102851 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b"} err="failed to get container status \"06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b\": rpc error: code = NotFound desc = could not find container \"06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b\": container with ID starting with 06a277058f6ebd77e00917e8620f2e08fe1b1467c7860c6ca260a455df92d53b not found: ID does not exist" Jun 13 03:49:31.120977 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.120926 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.105690931 podStartE2EDuration="2.120908105s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.217174ms" isStatefulPod=false podCreationTimestamp="2026-06-13 03:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:49:31.119056334 +0000 UTC m=+322.749718934" watchObservedRunningTime="2026-06-13 03:49:31.120908105 +0000 UTC m=+322.751570695" Jun 13 03:49:31.132633 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.132610 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-856fb87fdf-w5ft7"] Jun 13 03:49:31.138103 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.138082 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-856fb87fdf-w5ft7"] Jun 13 03:49:31.652264 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.652231 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-97895659f-fdzh7"] Jun 13 03:49:31.652531 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.652519 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7084595e-a9cc-4aff-a602-4126c54ffaf8" containerName="console" Jun 13 03:49:31.652575 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.652532 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7084595e-a9cc-4aff-a602-4126c54ffaf8" containerName="console" Jun 13 03:49:31.652616 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.652609 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7084595e-a9cc-4aff-a602-4126c54ffaf8" containerName="console" Jun 13 03:49:31.655433 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.655411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.658264 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.658246 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 13 03:49:31.658366 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.658291 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 13 03:49:31.658422 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.658366 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-whq4m\"" Jun 13 03:49:31.658422 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.658370 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 13 03:49:31.658521 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.658506 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 13 03:49:31.658725 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.658708 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 13 03:49:31.663789 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.663766 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 13 03:49:31.665782 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.665761 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-97895659f-fdzh7"] Jun 13 03:49:31.756208 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.756184 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-serving-certs-ca-bundle\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.756340 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.756224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-telemeter-client-tls\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.756340 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.756255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnnqx\" (UniqueName: \"kubernetes.io/projected/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-kube-api-access-qnnqx\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.756340 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.756275 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-metrics-client-ca\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.756340 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.756293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-federate-client-tls\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.756340 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.756311 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.756531 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.756362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-secret-telemeter-client\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.756531 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.756412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-telemeter-trusted-ca-bundle\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.857205 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.857169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-serving-certs-ca-bundle\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.857325 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.857218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-telemeter-client-tls\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.857384 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.857333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnnqx\" (UniqueName: \"kubernetes.io/projected/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-kube-api-access-qnnqx\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.857384 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.857366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-metrics-client-ca\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.857476 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.857386 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-federate-client-tls\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.857476 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.857417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.857476 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.857456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-secret-telemeter-client\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.857627 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.857500 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-telemeter-trusted-ca-bundle\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.858030 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.858008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-serving-certs-ca-bundle\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.858205 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.858032 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-metrics-client-ca\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.858467 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.858444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-telemeter-trusted-ca-bundle\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.859793 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.859768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-federate-client-tls\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.859948 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.859925 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-secret-telemeter-client\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.860051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.860031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.860207 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.860188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-telemeter-client-tls\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.865218 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.865195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnnqx\" (UniqueName: \"kubernetes.io/projected/7d790ce5-6339-4fcf-9e86-97dbeccbaf05-kube-api-access-qnnqx\") pod \"telemeter-client-97895659f-fdzh7\" (UID: \"7d790ce5-6339-4fcf-9e86-97dbeccbaf05\") " pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:31.965377 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:31.965353 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" Jun 13 03:49:32.097236 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:32.097201 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-97895659f-fdzh7"] Jun 13 03:49:32.098705 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:49:32.098667 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d790ce5_6339_4fcf_9e86_97dbeccbaf05.slice/crio-a70491fc937c2a26660d1855651c05ce9e111b24aacd24728a2a67b0c0e9cc6f WatchSource:0}: Error finding container a70491fc937c2a26660d1855651c05ce9e111b24aacd24728a2a67b0c0e9cc6f: Status 404 returned error can't find the container with id a70491fc937c2a26660d1855651c05ce9e111b24aacd24728a2a67b0c0e9cc6f Jun 13 03:49:32.100775 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:32.100753 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 03:49:32.850639 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:32.850603 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7084595e-a9cc-4aff-a602-4126c54ffaf8" path="/var/lib/kubelet/pods/7084595e-a9cc-4aff-a602-4126c54ffaf8/volumes" Jun 13 03:49:33.107290 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:33.107216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" event={"ID":"7d790ce5-6339-4fcf-9e86-97dbeccbaf05","Type":"ContainerStarted","Data":"a70491fc937c2a26660d1855651c05ce9e111b24aacd24728a2a67b0c0e9cc6f"} Jun 13 03:49:34.113165 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:34.113112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" event={"ID":"7d790ce5-6339-4fcf-9e86-97dbeccbaf05","Type":"ContainerStarted","Data":"f6341dbe45fc624b74b08ea7fd711eaf9073cdce510b05d49a3b906699699e75"} Jun 13 03:49:34.113479 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:34.113246 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" event={"ID":"7d790ce5-6339-4fcf-9e86-97dbeccbaf05","Type":"ContainerStarted","Data":"e5dded1dffa50fa26bc2aac6a32fd8365e81adf24e8b1de66b155b1f02a1c08a"} Jun 13 03:49:35.119241 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:35.119208 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" event={"ID":"7d790ce5-6339-4fcf-9e86-97dbeccbaf05","Type":"ContainerStarted","Data":"ead55406a242eca1d51e0ba758cf24f52e23783896b26af5ef77ac81203c7ff4"} Jun 13 03:49:35.142841 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:35.142783 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-97895659f-fdzh7" podStartSLOduration=2.292468809 podStartE2EDuration="4.142767999s" totalImagesPullingTime="1.85029919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:49:35.141287244 +0000 UTC m=+326.771949852" watchObservedRunningTime="2026-06-13 03:49:35.142767999 +0000 UTC m=+326.773430588" Jun 13 03:49:47.211912 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:49:47.211879 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7597f8cbc6-zgwm7"] Jun 13 03:50:12.232011 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.231947 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7597f8cbc6-zgwm7" podUID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" containerName="console" containerID="cri-o://b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6" gracePeriod=15 Jun 13 03:50:12.477347 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.477325 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:50:12.561217 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561154 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xhl7\" (UniqueName: \"kubernetes.io/projected/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-kube-api-access-4xhl7\") pod \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " Jun 13 03:50:12.561217 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561192 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-trusted-ca-bundle\") pod \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " Jun 13 03:50:12.561383 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561229 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-oauth-serving-cert\") pod \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " Jun 13 03:50:12.561383 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561338 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-oauth-config\") pod \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " Jun 13 03:50:12.561487 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561396 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-serving-cert\") pod \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " Jun 13 03:50:12.561487 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561453 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-service-ca\") pod \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " Jun 13 03:50:12.561487 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561483 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-config\") pod \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\" (UID: \"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc\") " Jun 13 03:50:12.561643 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561566 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" (UID: "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:50:12.561643 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561576 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" (UID: "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:50:12.561822 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561806 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-trusted-ca-bundle\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:50:12.561918 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561828 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-oauth-serving-cert\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:50:12.561918 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561868 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-config" (OuterVolumeSpecName: "console-config") pod "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" (UID: "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:50:12.561918 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.561877 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-service-ca" (OuterVolumeSpecName: "service-ca") pod "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" (UID: "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:50:12.563423 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.563399 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" (UID: "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:50:12.563550 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.563526 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" (UID: "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:50:12.563612 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.563589 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-kube-api-access-4xhl7" (OuterVolumeSpecName: "kube-api-access-4xhl7") pod "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" (UID: "30f832aa-cb8c-49ea-ab75-7ad53e7d97fc"). InnerVolumeSpecName "kube-api-access-4xhl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:50:12.662391 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.662368 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-oauth-config\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:50:12.662391 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.662388 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-serving-cert\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:50:12.662510 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.662398 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-service-ca\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:50:12.662510 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.662407 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-console-config\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:50:12.662510 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:12.662414 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xhl7\" (UniqueName: \"kubernetes.io/projected/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc-kube-api-access-4xhl7\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:50:13.272449 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:13.272416 2574 generic.go:356] "Generic (PLEG): container finished" podID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" containerID="b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6" exitCode=0 Jun 13 03:50:13.272795 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:13.272460 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7597f8cbc6-zgwm7" Jun 13 03:50:13.272795 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:13.272463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7597f8cbc6-zgwm7" event={"ID":"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc","Type":"ContainerDied","Data":"b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6"} Jun 13 03:50:13.272795 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:13.272582 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7597f8cbc6-zgwm7" event={"ID":"30f832aa-cb8c-49ea-ab75-7ad53e7d97fc","Type":"ContainerDied","Data":"344c8d568e4207b0653ac3a92908997f0beda4c6e8e9a30809b55a2fea6d8bec"} Jun 13 03:50:13.272795 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:13.272608 2574 scope.go:117] "RemoveContainer" containerID="b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6" Jun 13 03:50:13.280878 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:13.280860 2574 scope.go:117] "RemoveContainer" containerID="b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6" Jun 13 03:50:13.281171 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:50:13.281116 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6\": container with ID starting with b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6 not found: ID does not exist" containerID="b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6" Jun 13 03:50:13.281236 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:13.281185 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6"} err="failed to get container status \"b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6\": rpc error: code = NotFound desc = could not find container \"b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6\": container with ID starting with b56c60988fad48ba925d6350fe9fa4f5ce69339b86717ba6477d5edd7d3ce1e6 not found: ID does not exist" Jun 13 03:50:13.288535 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:13.288513 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7597f8cbc6-zgwm7"] Jun 13 03:50:13.293739 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:13.293719 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7597f8cbc6-zgwm7"] Jun 13 03:50:14.848091 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:50:14.848054 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" path="/var/lib/kubelet/pods/30f832aa-cb8c-49ea-ab75-7ad53e7d97fc/volumes" Jun 13 03:52:13.759592 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.759557 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt"] Jun 13 03:52:13.760020 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.759849 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" containerName="console" Jun 13 03:52:13.760020 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.759859 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" containerName="console" Jun 13 03:52:13.760020 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.759921 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f832aa-cb8c-49ea-ab75-7ad53e7d97fc" containerName="console" Jun 13 03:52:13.762603 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.762588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:13.765312 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.765288 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 03:52:13.766311 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.766295 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tdvjw\"" Jun 13 03:52:13.766387 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.766296 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 03:52:13.770226 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.770205 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt"] Jun 13 03:52:13.850440 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.850415 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkl9c\" (UniqueName: \"kubernetes.io/projected/a15d958a-d53c-4e94-9b39-23ba72d22bf7-kube-api-access-xkl9c\") pod \"cert-manager-webhook-7dc76cbb94-2dwdt\" (UID: \"a15d958a-d53c-4e94-9b39-23ba72d22bf7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:13.850556 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.850482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a15d958a-d53c-4e94-9b39-23ba72d22bf7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-2dwdt\" (UID: \"a15d958a-d53c-4e94-9b39-23ba72d22bf7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:13.951447 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.951424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a15d958a-d53c-4e94-9b39-23ba72d22bf7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-2dwdt\" (UID: \"a15d958a-d53c-4e94-9b39-23ba72d22bf7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:13.951545 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.951455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkl9c\" (UniqueName: \"kubernetes.io/projected/a15d958a-d53c-4e94-9b39-23ba72d22bf7-kube-api-access-xkl9c\") pod \"cert-manager-webhook-7dc76cbb94-2dwdt\" (UID: \"a15d958a-d53c-4e94-9b39-23ba72d22bf7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:13.960082 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.960064 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkl9c\" (UniqueName: \"kubernetes.io/projected/a15d958a-d53c-4e94-9b39-23ba72d22bf7-kube-api-access-xkl9c\") pod \"cert-manager-webhook-7dc76cbb94-2dwdt\" (UID: \"a15d958a-d53c-4e94-9b39-23ba72d22bf7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:13.960171 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:13.960091 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a15d958a-d53c-4e94-9b39-23ba72d22bf7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-2dwdt\" (UID: \"a15d958a-d53c-4e94-9b39-23ba72d22bf7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:14.071595 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:14.071539 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:14.221565 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:14.221542 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt"] Jun 13 03:52:14.224018 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:52:14.223993 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda15d958a_d53c_4e94_9b39_23ba72d22bf7.slice/crio-e7533e26c20392ebf6add8eb3316de61fd5929127fdee0d7df5cd0801b19cea8 WatchSource:0}: Error finding container e7533e26c20392ebf6add8eb3316de61fd5929127fdee0d7df5cd0801b19cea8: Status 404 returned error can't find the container with id e7533e26c20392ebf6add8eb3316de61fd5929127fdee0d7df5cd0801b19cea8 Jun 13 03:52:14.729754 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:14.729724 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" event={"ID":"a15d958a-d53c-4e94-9b39-23ba72d22bf7","Type":"ContainerStarted","Data":"e7533e26c20392ebf6add8eb3316de61fd5929127fdee0d7df5cd0801b19cea8"} Jun 13 03:52:17.743707 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:17.743674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" event={"ID":"a15d958a-d53c-4e94-9b39-23ba72d22bf7","Type":"ContainerStarted","Data":"5f24231370ffaed41675b1d66bf152016810e94331ab46c909da88a5eaab7acc"} Jun 13 03:52:17.744098 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:17.743715 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:17.759438 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:17.759385 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" podStartSLOduration=1.7676600439999999 podStartE2EDuration="4.759370526s" totalImagesPullingTime="2.991710482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:52:17.758083421 +0000 UTC m=+489.388746011" watchObservedRunningTime="2026-06-13 03:52:17.759370526 +0000 UTC m=+489.390033114" Jun 13 03:52:23.591347 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.591312 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv"] Jun 13 03:52:23.594648 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.594632 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" Jun 13 03:52:23.597055 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.597033 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 03:52:23.597229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.597196 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:52:23.598205 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.598188 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h85g8\"" Jun 13 03:52:23.601785 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.601763 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv"] Jun 13 03:52:23.731561 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.731538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48c92\" (UniqueName: \"kubernetes.io/projected/563728c4-3fda-4887-872d-18237397aba6-kube-api-access-48c92\") pod \"openshift-lws-operator-fd8ccff4c-g8wkv\" (UID: \"563728c4-3fda-4887-872d-18237397aba6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" Jun 13 03:52:23.731679 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.731579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/563728c4-3fda-4887-872d-18237397aba6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g8wkv\" (UID: \"563728c4-3fda-4887-872d-18237397aba6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" Jun 13 03:52:23.749219 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.749199 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2dwdt" Jun 13 03:52:23.832697 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.832666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/563728c4-3fda-4887-872d-18237397aba6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g8wkv\" (UID: \"563728c4-3fda-4887-872d-18237397aba6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" Jun 13 03:52:23.832821 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.832725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48c92\" (UniqueName: \"kubernetes.io/projected/563728c4-3fda-4887-872d-18237397aba6-kube-api-access-48c92\") pod \"openshift-lws-operator-fd8ccff4c-g8wkv\" (UID: \"563728c4-3fda-4887-872d-18237397aba6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" Jun 13 03:52:23.833024 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.833008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/563728c4-3fda-4887-872d-18237397aba6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g8wkv\" (UID: \"563728c4-3fda-4887-872d-18237397aba6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" Jun 13 03:52:23.844932 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.844882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48c92\" (UniqueName: \"kubernetes.io/projected/563728c4-3fda-4887-872d-18237397aba6-kube-api-access-48c92\") pod \"openshift-lws-operator-fd8ccff4c-g8wkv\" (UID: \"563728c4-3fda-4887-872d-18237397aba6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" Jun 13 03:52:23.903785 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:23.903764 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" Jun 13 03:52:24.027483 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:24.027460 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv"] Jun 13 03:52:24.031141 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:52:24.031094 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod563728c4_3fda_4887_872d_18237397aba6.slice/crio-8c2746529b87bdf4530fb0d774d65e194e48e2c3b9ed3c60496c1ad42742777f WatchSource:0}: Error finding container 8c2746529b87bdf4530fb0d774d65e194e48e2c3b9ed3c60496c1ad42742777f: Status 404 returned error can't find the container with id 8c2746529b87bdf4530fb0d774d65e194e48e2c3b9ed3c60496c1ad42742777f Jun 13 03:52:24.772653 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:24.772591 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" event={"ID":"563728c4-3fda-4887-872d-18237397aba6","Type":"ContainerStarted","Data":"8c2746529b87bdf4530fb0d774d65e194e48e2c3b9ed3c60496c1ad42742777f"} Jun 13 03:52:26.782286 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:26.782254 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" event={"ID":"563728c4-3fda-4887-872d-18237397aba6","Type":"ContainerStarted","Data":"9afc6a4a1c02c6372248214cf375d3db71c6bf2371b75949521730b8569276d2"} Jun 13 03:52:26.801556 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:26.801515 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g8wkv" podStartSLOduration=1.468325379 podStartE2EDuration="3.801501332s" totalImagesPullingTime="2.333175953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:52:26.799900191 +0000 UTC m=+498.430562780" watchObservedRunningTime="2026-06-13 03:52:26.801501332 +0000 UTC m=+498.432163921" Jun 13 03:52:42.118847 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.118807 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf"] Jun 13 03:52:42.186809 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.186776 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf"] Jun 13 03:52:42.186980 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.186878 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.189290 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.189265 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 03:52:42.189666 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.189649 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 03:52:42.189738 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.189652 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 03:52:42.189738 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.189726 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8f8dz\"" Jun 13 03:52:42.189824 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.189768 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 03:52:42.273508 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.273484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/315638a9-60d1-41dc-af7e-c4e97f3f18b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.273610 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.273532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/315638a9-60d1-41dc-af7e-c4e97f3f18b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.273610 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.273556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/315638a9-60d1-41dc-af7e-c4e97f3f18b4-tmp\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.273610 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.273581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkn8k\" (UniqueName: \"kubernetes.io/projected/315638a9-60d1-41dc-af7e-c4e97f3f18b4-kube-api-access-pkn8k\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.273610 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.273605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/315638a9-60d1-41dc-af7e-c4e97f3f18b4-manifests\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.374808 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.374754 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/315638a9-60d1-41dc-af7e-c4e97f3f18b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.374808 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.374784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/315638a9-60d1-41dc-af7e-c4e97f3f18b4-tmp\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.374808 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.374808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkn8k\" (UniqueName: \"kubernetes.io/projected/315638a9-60d1-41dc-af7e-c4e97f3f18b4-kube-api-access-pkn8k\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.374973 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.374838 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/315638a9-60d1-41dc-af7e-c4e97f3f18b4-manifests\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.374973 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.374873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/315638a9-60d1-41dc-af7e-c4e97f3f18b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.375290 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.375271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/315638a9-60d1-41dc-af7e-c4e97f3f18b4-manifests\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.377072 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.377052 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/315638a9-60d1-41dc-af7e-c4e97f3f18b4-tmp\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.377232 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.377213 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/315638a9-60d1-41dc-af7e-c4e97f3f18b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.377383 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.377366 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/315638a9-60d1-41dc-af7e-c4e97f3f18b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.382157 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.382117 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkn8k\" (UniqueName: \"kubernetes.io/projected/315638a9-60d1-41dc-af7e-c4e97f3f18b4-kube-api-access-pkn8k\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-l58kf\" (UID: \"315638a9-60d1-41dc-af7e-c4e97f3f18b4\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.496808 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.496785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:42.646435 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.646410 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf"] Jun 13 03:52:42.648813 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:52:42.648778 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315638a9_60d1_41dc_af7e_c4e97f3f18b4.slice/crio-76e60dd30b89b2db108523e37f7b663735e1e47a14d9d68a1df6289fe4b0b733 WatchSource:0}: Error finding container 76e60dd30b89b2db108523e37f7b663735e1e47a14d9d68a1df6289fe4b0b733: Status 404 returned error can't find the container with id 76e60dd30b89b2db108523e37f7b663735e1e47a14d9d68a1df6289fe4b0b733 Jun 13 03:52:42.848418 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:42.848385 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" event={"ID":"315638a9-60d1-41dc-af7e-c4e97f3f18b4","Type":"ContainerStarted","Data":"76e60dd30b89b2db108523e37f7b663735e1e47a14d9d68a1df6289fe4b0b733"} Jun 13 03:52:45.862926 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:45.862885 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" event={"ID":"315638a9-60d1-41dc-af7e-c4e97f3f18b4","Type":"ContainerStarted","Data":"fd9e40103d035d7bb67d40e9e1d7b65607564990e22af5044de74532e25007de"} Jun 13 03:52:46.867634 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:46.867599 2574 generic.go:356] "Generic (PLEG): container finished" podID="315638a9-60d1-41dc-af7e-c4e97f3f18b4" containerID="fd9e40103d035d7bb67d40e9e1d7b65607564990e22af5044de74532e25007de" exitCode=0 Jun 13 03:52:46.868076 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:46.867660 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" event={"ID":"315638a9-60d1-41dc-af7e-c4e97f3f18b4","Type":"ContainerDied","Data":"fd9e40103d035d7bb67d40e9e1d7b65607564990e22af5044de74532e25007de"} Jun 13 03:52:47.875194 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:47.875162 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" event={"ID":"315638a9-60d1-41dc-af7e-c4e97f3f18b4","Type":"ContainerStarted","Data":"7b4b19cb5c1dead2dbd761a800e0c5cbb89563f95a86b27de96586fb1e2849fc"} Jun 13 03:52:47.875667 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:47.875273 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:52:47.895016 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:47.894971 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" podStartSLOduration=2.07977191 podStartE2EDuration="5.894958527s" totalImagesPullingTime="2.910702086s" totalInitContainerRuntime="904.484531ms" isStatefulPod=false podCreationTimestamp="2026-06-13 03:52:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:52:47.893296772 +0000 UTC m=+519.523959362" watchObservedRunningTime="2026-06-13 03:52:47.894958527 +0000 UTC m=+519.525621115" Jun 13 03:52:58.881600 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:52:58.881521 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-l58kf" Jun 13 03:53:02.180038 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.180002 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n"] Jun 13 03:53:02.183968 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.183948 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.186661 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.186636 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 03:53:02.187906 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.187881 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 03:53:02.188025 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.187950 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 03:53:02.188025 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.188015 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j5rvt\"" Jun 13 03:53:02.188198 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.188172 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 03:53:02.196394 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.196372 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n"] Jun 13 03:53:02.246732 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.246704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-tmp\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.246869 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.246754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-tls-certs\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.246869 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.246781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk2c7\" (UniqueName: \"kubernetes.io/projected/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-kube-api-access-jk2c7\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.348160 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.348107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-tls-certs\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.348333 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.348165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk2c7\" (UniqueName: \"kubernetes.io/projected/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-kube-api-access-jk2c7\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.348333 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:53:02.348278 2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 13 03:53:02.348333 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.348316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-tmp\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.348539 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:53:02.348367 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-tls-certs podName:0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb nodeName:}" failed. No retries permitted until 2026-06-13 03:53:02.848344457 +0000 UTC m=+534.479007037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-tls-certs") pod "kube-auth-proxy-75bd78495b-7pj8n" (UID: "0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb") : secret "kube-auth-proxy-tls" not found Jun 13 03:53:02.351016 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.350993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-tmp\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.358654 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.358632 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk2c7\" (UniqueName: \"kubernetes.io/projected/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-kube-api-access-jk2c7\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.853796 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.853759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-tls-certs\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.856387 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.856352 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb-tls-certs\") pod \"kube-auth-proxy-75bd78495b-7pj8n\" (UID: \"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:02.880824 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.880796 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-gsk6j"] Jun 13 03:53:02.884162 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.884143 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:02.886692 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.886674 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 13 03:53:02.895891 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.895869 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-gsk6j"] Jun 13 03:53:02.954170 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.954138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e963f2-757b-4a44-83a1-2d110e55928d-tls-certs\") pod \"model-serving-api-5dd488fc48-gsk6j\" (UID: \"72e963f2-757b-4a44-83a1-2d110e55928d\") " pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:02.954350 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:02.954191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7684s\" (UniqueName: \"kubernetes.io/projected/72e963f2-757b-4a44-83a1-2d110e55928d-kube-api-access-7684s\") pod \"model-serving-api-5dd488fc48-gsk6j\" (UID: \"72e963f2-757b-4a44-83a1-2d110e55928d\") " pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:03.055497 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.055466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e963f2-757b-4a44-83a1-2d110e55928d-tls-certs\") pod \"model-serving-api-5dd488fc48-gsk6j\" (UID: \"72e963f2-757b-4a44-83a1-2d110e55928d\") " pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:03.055687 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.055517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7684s\" (UniqueName: \"kubernetes.io/projected/72e963f2-757b-4a44-83a1-2d110e55928d-kube-api-access-7684s\") pod \"model-serving-api-5dd488fc48-gsk6j\" (UID: \"72e963f2-757b-4a44-83a1-2d110e55928d\") " pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:03.058103 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.058067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e963f2-757b-4a44-83a1-2d110e55928d-tls-certs\") pod \"model-serving-api-5dd488fc48-gsk6j\" (UID: \"72e963f2-757b-4a44-83a1-2d110e55928d\") " pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:03.067834 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.067807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7684s\" (UniqueName: \"kubernetes.io/projected/72e963f2-757b-4a44-83a1-2d110e55928d-kube-api-access-7684s\") pod \"model-serving-api-5dd488fc48-gsk6j\" (UID: \"72e963f2-757b-4a44-83a1-2d110e55928d\") " pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:03.096094 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.096071 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" Jun 13 03:53:03.194981 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.194934 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:03.225959 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.225909 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n"] Jun 13 03:53:03.229376 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:53:03.229342 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2f4c8a_fca1_404f_a4a6_a7a46d11aecb.slice/crio-421a221dce63e8d6a2d69f9cfad1aa205f250c4a05e9a8ed97f91acfdbb71170 WatchSource:0}: Error finding container 421a221dce63e8d6a2d69f9cfad1aa205f250c4a05e9a8ed97f91acfdbb71170: Status 404 returned error can't find the container with id 421a221dce63e8d6a2d69f9cfad1aa205f250c4a05e9a8ed97f91acfdbb71170 Jun 13 03:53:03.326260 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.326235 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-gsk6j"] Jun 13 03:53:03.329314 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:53:03.329290 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e963f2_757b_4a44_83a1_2d110e55928d.slice/crio-3bb1c36a6e27d29f5355ff0a57611fabf0329f884e78ff17b91e1134d967ddbf WatchSource:0}: Error finding container 3bb1c36a6e27d29f5355ff0a57611fabf0329f884e78ff17b91e1134d967ddbf: Status 404 returned error can't find the container with id 3bb1c36a6e27d29f5355ff0a57611fabf0329f884e78ff17b91e1134d967ddbf Jun 13 03:53:03.963507 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.963403 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" event={"ID":"72e963f2-757b-4a44-83a1-2d110e55928d","Type":"ContainerStarted","Data":"3bb1c36a6e27d29f5355ff0a57611fabf0329f884e78ff17b91e1134d967ddbf"} Jun 13 03:53:03.966526 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:03.966464 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" event={"ID":"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb","Type":"ContainerStarted","Data":"421a221dce63e8d6a2d69f9cfad1aa205f250c4a05e9a8ed97f91acfdbb71170"} Jun 13 03:53:06.986056 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:06.986020 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" event={"ID":"72e963f2-757b-4a44-83a1-2d110e55928d","Type":"ContainerStarted","Data":"92581192fd66d05656fa330226c13e983044a6f1bbcf95dd2e20a4fa33897e95"} Jun 13 03:53:06.986533 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:06.986226 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:06.987534 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:06.987510 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" event={"ID":"0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb","Type":"ContainerStarted","Data":"49bad6672edaaedb394c501d195be1bb6b219ecd95062ed95e9955d61fdaf11a"} Jun 13 03:53:07.003430 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:07.003387 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" podStartSLOduration=1.697821687 podStartE2EDuration="5.003367084s" totalImagesPullingTime="3.305545397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:07.002737126 +0000 UTC m=+538.633399716" watchObservedRunningTime="2026-06-13 03:53:07.003367084 +0000 UTC m=+538.634029673" Jun 13 03:53:07.017895 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:07.017857 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75bd78495b-7pj8n" podStartSLOduration=1.599786242 podStartE2EDuration="5.017846042s" totalImagesPullingTime="3.4180598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:07.017215213 +0000 UTC m=+538.647877801" watchObservedRunningTime="2026-06-13 03:53:07.017846042 +0000 UTC m=+538.648508685" Jun 13 03:53:12.181872 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.181837 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6s6wx"] Jun 13 03:53:12.188018 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.187992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6s6wx"] Jun 13 03:53:12.188399 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.188377 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:12.189567 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.189549 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6"] Jun 13 03:53:12.192170 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.191968 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 13 03:53:12.194569 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.194549 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:12.195150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.195113 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7qq8j\"" Jun 13 03:53:12.198096 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.198080 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 13 03:53:12.198306 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.198269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9bxcx\"" Jun 13 03:53:12.206035 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.206013 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6"] Jun 13 03:53:12.334578 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.334541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1f21225-2ae4-47b9-a40c-ca199cb5c300-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-k4ml6\" (UID: \"a1f21225-2ae4-47b9-a40c-ca199cb5c300\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:12.334717 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.334608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdv6h\" (UniqueName: \"kubernetes.io/projected/a1f21225-2ae4-47b9-a40c-ca199cb5c300-kube-api-access-tdv6h\") pod \"llmisvc-controller-manager-864bfd7bc9-k4ml6\" (UID: \"a1f21225-2ae4-47b9-a40c-ca199cb5c300\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:12.334717 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.334638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e65049b-dec5-426c-aa3d-4e6dd2077bee-cert\") pod \"kserve-controller-manager-69fc866d76-6s6wx\" (UID: \"5e65049b-dec5-426c-aa3d-4e6dd2077bee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:12.334717 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.334680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj6zn\" (UniqueName: \"kubernetes.io/projected/5e65049b-dec5-426c-aa3d-4e6dd2077bee-kube-api-access-mj6zn\") pod \"kserve-controller-manager-69fc866d76-6s6wx\" (UID: \"5e65049b-dec5-426c-aa3d-4e6dd2077bee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:12.435778 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.435691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdv6h\" (UniqueName: \"kubernetes.io/projected/a1f21225-2ae4-47b9-a40c-ca199cb5c300-kube-api-access-tdv6h\") pod \"llmisvc-controller-manager-864bfd7bc9-k4ml6\" (UID: \"a1f21225-2ae4-47b9-a40c-ca199cb5c300\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:12.435778 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.435727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e65049b-dec5-426c-aa3d-4e6dd2077bee-cert\") pod \"kserve-controller-manager-69fc866d76-6s6wx\" (UID: \"5e65049b-dec5-426c-aa3d-4e6dd2077bee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:12.435778 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.435757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6zn\" (UniqueName: \"kubernetes.io/projected/5e65049b-dec5-426c-aa3d-4e6dd2077bee-kube-api-access-mj6zn\") pod \"kserve-controller-manager-69fc866d76-6s6wx\" (UID: \"5e65049b-dec5-426c-aa3d-4e6dd2077bee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:12.436051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.435803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1f21225-2ae4-47b9-a40c-ca199cb5c300-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-k4ml6\" (UID: \"a1f21225-2ae4-47b9-a40c-ca199cb5c300\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:12.436051 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:53:12.435906 2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 13 03:53:12.436051 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:53:12.435971 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f21225-2ae4-47b9-a40c-ca199cb5c300-cert podName:a1f21225-2ae4-47b9-a40c-ca199cb5c300 nodeName:}" failed. No retries permitted until 2026-06-13 03:53:12.935954795 +0000 UTC m=+544.566617362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a1f21225-2ae4-47b9-a40c-ca199cb5c300-cert") pod "llmisvc-controller-manager-864bfd7bc9-k4ml6" (UID: "a1f21225-2ae4-47b9-a40c-ca199cb5c300") : secret "llmisvc-webhook-server-cert" not found Jun 13 03:53:12.438338 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.438311 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e65049b-dec5-426c-aa3d-4e6dd2077bee-cert\") pod \"kserve-controller-manager-69fc866d76-6s6wx\" (UID: \"5e65049b-dec5-426c-aa3d-4e6dd2077bee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:12.444654 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.444621 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdv6h\" (UniqueName: \"kubernetes.io/projected/a1f21225-2ae4-47b9-a40c-ca199cb5c300-kube-api-access-tdv6h\") pod \"llmisvc-controller-manager-864bfd7bc9-k4ml6\" (UID: \"a1f21225-2ae4-47b9-a40c-ca199cb5c300\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:12.445621 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.445588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj6zn\" (UniqueName: \"kubernetes.io/projected/5e65049b-dec5-426c-aa3d-4e6dd2077bee-kube-api-access-mj6zn\") pod \"kserve-controller-manager-69fc866d76-6s6wx\" (UID: \"5e65049b-dec5-426c-aa3d-4e6dd2077bee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:12.510749 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.510725 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:12.645168 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.645143 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-6s6wx"] Jun 13 03:53:12.647111 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:53:12.647084 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e65049b_dec5_426c_aa3d_4e6dd2077bee.slice/crio-b2dd2aac9d345217be50424ee23b8f823fa2ecdea788747adcc9d4865c89d3d4 WatchSource:0}: Error finding container b2dd2aac9d345217be50424ee23b8f823fa2ecdea788747adcc9d4865c89d3d4: Status 404 returned error can't find the container with id b2dd2aac9d345217be50424ee23b8f823fa2ecdea788747adcc9d4865c89d3d4 Jun 13 03:53:12.940759 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.940734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1f21225-2ae4-47b9-a40c-ca199cb5c300-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-k4ml6\" (UID: \"a1f21225-2ae4-47b9-a40c-ca199cb5c300\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:12.943115 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:12.943096 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1f21225-2ae4-47b9-a40c-ca199cb5c300-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-k4ml6\" (UID: \"a1f21225-2ae4-47b9-a40c-ca199cb5c300\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:13.013092 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:13.013058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" event={"ID":"5e65049b-dec5-426c-aa3d-4e6dd2077bee","Type":"ContainerStarted","Data":"b2dd2aac9d345217be50424ee23b8f823fa2ecdea788747adcc9d4865c89d3d4"} Jun 13 03:53:13.116283 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:13.116248 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:13.257261 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:13.257227 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6"] Jun 13 03:53:13.261026 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:53:13.260995 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda1f21225_2ae4_47b9_a40c_ca199cb5c300.slice/crio-fa51874babc18b00cb5114705050c7bdc7e3901d80ac31392b6290b23cd07bb6 WatchSource:0}: Error finding container fa51874babc18b00cb5114705050c7bdc7e3901d80ac31392b6290b23cd07bb6: Status 404 returned error can't find the container with id fa51874babc18b00cb5114705050c7bdc7e3901d80ac31392b6290b23cd07bb6 Jun 13 03:53:14.021615 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:14.021388 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" event={"ID":"a1f21225-2ae4-47b9-a40c-ca199cb5c300","Type":"ContainerStarted","Data":"fa51874babc18b00cb5114705050c7bdc7e3901d80ac31392b6290b23cd07bb6"} Jun 13 03:53:16.035045 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:16.035012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" event={"ID":"5e65049b-dec5-426c-aa3d-4e6dd2077bee","Type":"ContainerStarted","Data":"58795ed26f8bfabb2d53ca256ed8961fd88695331280bca269241eac2ed68837"} Jun 13 03:53:16.035440 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:16.035159 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:16.051002 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:16.050961 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" podStartSLOduration=1.488896923 podStartE2EDuration="4.050946301s" totalImagesPullingTime="2.562049378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:16.049460163 +0000 UTC m=+547.680122749" watchObservedRunningTime="2026-06-13 03:53:16.050946301 +0000 UTC m=+547.681608890" Jun 13 03:53:17.041372 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:17.041335 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" event={"ID":"a1f21225-2ae4-47b9-a40c-ca199cb5c300","Type":"ContainerStarted","Data":"84a74fef81b7cdfd6d230425dc0d48d89e8bd4d3fdca3c49bfeaacea9214289a"} Jun 13 03:53:17.041773 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:17.041459 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:17.059500 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:17.059458 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" podStartSLOduration=2.233283343 podStartE2EDuration="5.059443535s" totalImagesPullingTime="2.826160192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:17.057431433 +0000 UTC m=+548.688094022" watchObservedRunningTime="2026-06-13 03:53:17.059443535 +0000 UTC m=+548.690106123" Jun 13 03:53:18.002586 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:18.002558 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-gsk6j" Jun 13 03:53:26.598294 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.598260 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-48qbn"] Jun 13 03:53:26.601762 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.601743 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:26.604551 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.604532 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 13 03:53:26.604678 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.604597 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 13 03:53:26.604737 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.604694 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-sg758\"" Jun 13 03:53:26.614708 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.614681 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-48qbn"] Jun 13 03:53:26.662014 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.661988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s5hr\" (UniqueName: \"kubernetes.io/projected/cf8f4967-fe5b-4562-a6ef-849b57eeb0dd-kube-api-access-6s5hr\") pod \"servicemesh-operator3-57f65f65fb-48qbn\" (UID: \"cf8f4967-fe5b-4562-a6ef-849b57eeb0dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:26.662108 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.662065 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf8f4967-fe5b-4562-a6ef-849b57eeb0dd-operator-config\") pod \"servicemesh-operator3-57f65f65fb-48qbn\" (UID: \"cf8f4967-fe5b-4562-a6ef-849b57eeb0dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:26.763075 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.763046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s5hr\" (UniqueName: \"kubernetes.io/projected/cf8f4967-fe5b-4562-a6ef-849b57eeb0dd-kube-api-access-6s5hr\") pod \"servicemesh-operator3-57f65f65fb-48qbn\" (UID: \"cf8f4967-fe5b-4562-a6ef-849b57eeb0dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:26.763229 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.763153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf8f4967-fe5b-4562-a6ef-849b57eeb0dd-operator-config\") pod \"servicemesh-operator3-57f65f65fb-48qbn\" (UID: \"cf8f4967-fe5b-4562-a6ef-849b57eeb0dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:26.765411 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.765386 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf8f4967-fe5b-4562-a6ef-849b57eeb0dd-operator-config\") pod \"servicemesh-operator3-57f65f65fb-48qbn\" (UID: \"cf8f4967-fe5b-4562-a6ef-849b57eeb0dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:26.772493 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.772469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s5hr\" (UniqueName: \"kubernetes.io/projected/cf8f4967-fe5b-4562-a6ef-849b57eeb0dd-kube-api-access-6s5hr\") pod \"servicemesh-operator3-57f65f65fb-48qbn\" (UID: \"cf8f4967-fe5b-4562-a6ef-849b57eeb0dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:26.911040 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:26.910964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:27.050201 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:27.050172 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-48qbn"] Jun 13 03:53:27.052668 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:53:27.052643 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8f4967_fe5b_4562_a6ef_849b57eeb0dd.slice/crio-cd9521d7925685605c902b55655a818b18f5e1de43ce0845bc4e85809bf92548 WatchSource:0}: Error finding container cd9521d7925685605c902b55655a818b18f5e1de43ce0845bc4e85809bf92548: Status 404 returned error can't find the container with id cd9521d7925685605c902b55655a818b18f5e1de43ce0845bc4e85809bf92548 Jun 13 03:53:27.088741 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:27.088713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" event={"ID":"cf8f4967-fe5b-4562-a6ef-849b57eeb0dd","Type":"ContainerStarted","Data":"cd9521d7925685605c902b55655a818b18f5e1de43ce0845bc4e85809bf92548"} Jun 13 03:53:30.108119 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:30.108023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" event={"ID":"cf8f4967-fe5b-4562-a6ef-849b57eeb0dd","Type":"ContainerStarted","Data":"a5013438938618bde7b9864baec1d30f0bf0cedbd5f5775ea851e5e20368b43a"} Jun 13 03:53:30.108119 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:30.108101 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:30.130170 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:30.130105 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" podStartSLOduration=1.458424742 podStartE2EDuration="4.130089283s" totalImagesPullingTime="2.671664541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:30.127881668 +0000 UTC m=+561.758544290" watchObservedRunningTime="2026-06-13 03:53:30.130089283 +0000 UTC m=+561.760751872" Jun 13 03:53:32.532090 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.532052 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-b765c74d8-wrcst"] Jun 13 03:53:32.536100 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.536081 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" Jun 13 03:53:32.538878 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.538854 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 13 03:53:32.539025 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.538896 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-64jhs\"" Jun 13 03:53:32.544023 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.543656 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-b765c74d8-wrcst"] Jun 13 03:53:32.614987 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.614947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8sx\" (UniqueName: \"kubernetes.io/projected/2997320f-3207-4c0a-bc09-b0b3cd3c2fbe-kube-api-access-fz8sx\") pod \"dashboard-redirect-b765c74d8-wrcst\" (UID: \"2997320f-3207-4c0a-bc09-b0b3cd3c2fbe\") " pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" Jun 13 03:53:32.615176 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.615074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2997320f-3207-4c0a-bc09-b0b3cd3c2fbe-redirect-config\") pod \"dashboard-redirect-b765c74d8-wrcst\" (UID: \"2997320f-3207-4c0a-bc09-b0b3cd3c2fbe\") " pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" Jun 13 03:53:32.716442 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.716412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2997320f-3207-4c0a-bc09-b0b3cd3c2fbe-redirect-config\") pod \"dashboard-redirect-b765c74d8-wrcst\" (UID: \"2997320f-3207-4c0a-bc09-b0b3cd3c2fbe\") " pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" Jun 13 03:53:32.716584 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.716454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8sx\" (UniqueName: \"kubernetes.io/projected/2997320f-3207-4c0a-bc09-b0b3cd3c2fbe-kube-api-access-fz8sx\") pod \"dashboard-redirect-b765c74d8-wrcst\" (UID: \"2997320f-3207-4c0a-bc09-b0b3cd3c2fbe\") " pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" Jun 13 03:53:32.717099 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.717076 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2997320f-3207-4c0a-bc09-b0b3cd3c2fbe-redirect-config\") pod \"dashboard-redirect-b765c74d8-wrcst\" (UID: \"2997320f-3207-4c0a-bc09-b0b3cd3c2fbe\") " pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" Jun 13 03:53:32.726314 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.726294 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8sx\" (UniqueName: \"kubernetes.io/projected/2997320f-3207-4c0a-bc09-b0b3cd3c2fbe-kube-api-access-fz8sx\") pod \"dashboard-redirect-b765c74d8-wrcst\" (UID: \"2997320f-3207-4c0a-bc09-b0b3cd3c2fbe\") " pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" Jun 13 03:53:32.848450 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.848387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" Jun 13 03:53:32.976253 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:32.976226 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-b765c74d8-wrcst"] Jun 13 03:53:32.978690 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:53:32.978663 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2997320f_3207_4c0a_bc09_b0b3cd3c2fbe.slice/crio-ee4da01ad02fe16391fe0b8203cb66eaffd20b70067ceaf3bcd112365b64baa4 WatchSource:0}: Error finding container ee4da01ad02fe16391fe0b8203cb66eaffd20b70067ceaf3bcd112365b64baa4: Status 404 returned error can't find the container with id ee4da01ad02fe16391fe0b8203cb66eaffd20b70067ceaf3bcd112365b64baa4 Jun 13 03:53:33.123758 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:33.123684 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" event={"ID":"2997320f-3207-4c0a-bc09-b0b3cd3c2fbe","Type":"ContainerStarted","Data":"ee4da01ad02fe16391fe0b8203cb66eaffd20b70067ceaf3bcd112365b64baa4"} Jun 13 03:53:35.134690 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:35.134657 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" event={"ID":"2997320f-3207-4c0a-bc09-b0b3cd3c2fbe","Type":"ContainerStarted","Data":"eaf7fef7963a07dde986e0f9fc3c3b068245b4b72c0e4d84cfb27246309a11bf"} Jun 13 03:53:35.154650 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:35.154572 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-b765c74d8-wrcst" podStartSLOduration=1.2283553010000001 podStartE2EDuration="3.154557137s" totalImagesPullingTime="1.926201836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:35.153794299 +0000 UTC m=+566.784456889" watchObservedRunningTime="2026-06-13 03:53:35.154557137 +0000 UTC m=+566.785219725" Jun 13 03:53:41.114949 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:41.114915 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-48qbn" Jun 13 03:53:47.046259 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:47.046230 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-6s6wx" Jun 13 03:53:48.048727 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:48.048696 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-k4ml6" Jun 13 03:53:53.682920 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.682879 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m"] Jun 13 03:53:53.690255 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.690233 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.692831 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.692810 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 13 03:53:53.692977 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.692842 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 13 03:53:53.692977 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.692890 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 13 03:53:53.693161 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.692992 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gnwqs\"" Jun 13 03:53:53.693485 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.693457 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 13 03:53:53.696244 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.696221 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m"] Jun 13 03:53:53.792349 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.792322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.792474 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.792352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c87jl\" (UniqueName: \"kubernetes.io/projected/39428403-f0b4-447f-aa88-b83cb0d4b449-kube-api-access-c87jl\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.792474 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.792381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39428403-f0b4-447f-aa88-b83cb0d4b449-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.792474 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.792457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.792584 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.792499 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.792584 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.792537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.792584 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.792570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39428403-f0b4-447f-aa88-b83cb0d4b449-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.893167 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.893114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.893319 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.893197 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39428403-f0b4-447f-aa88-b83cb0d4b449-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.893319 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.893249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.893319 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.893276 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87jl\" (UniqueName: \"kubernetes.io/projected/39428403-f0b4-447f-aa88-b83cb0d4b449-kube-api-access-c87jl\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.893319 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.893300 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39428403-f0b4-447f-aa88-b83cb0d4b449-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.893527 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.893334 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.893527 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.893384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.894051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.894026 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.895573 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.895546 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39428403-f0b4-447f-aa88-b83cb0d4b449-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.895689 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.895622 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.895746 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.895696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39428403-f0b4-447f-aa88-b83cb0d4b449-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.895929 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.895911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.903670 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.903651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39428403-f0b4-447f-aa88-b83cb0d4b449-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:53.903952 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:53.903932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c87jl\" (UniqueName: \"kubernetes.io/projected/39428403-f0b4-447f-aa88-b83cb0d4b449-kube-api-access-c87jl\") pod \"istiod-openshift-gateway-75c67f8887-pzc7m\" (UID: \"39428403-f0b4-447f-aa88-b83cb0d4b449\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:54.001172 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:54.001087 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:54.134149 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:54.134106 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m"] Jun 13 03:53:54.136208 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:53:54.136182 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39428403_f0b4_447f_aa88_b83cb0d4b449.slice/crio-a7d81c99f30faf3f4a6797a5d5ae241e3a1d03e5d98644d89decc16e7bb3743d WatchSource:0}: Error finding container a7d81c99f30faf3f4a6797a5d5ae241e3a1d03e5d98644d89decc16e7bb3743d: Status 404 returned error can't find the container with id a7d81c99f30faf3f4a6797a5d5ae241e3a1d03e5d98644d89decc16e7bb3743d Jun 13 03:53:54.221003 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:54.220971 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" event={"ID":"39428403-f0b4-447f-aa88-b83cb0d4b449","Type":"ContainerStarted","Data":"a7d81c99f30faf3f4a6797a5d5ae241e3a1d03e5d98644d89decc16e7bb3743d"} Jun 13 03:53:56.528960 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:56.528920 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 03:53:56.529269 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:56.528989 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 03:53:57.238515 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:57.238482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" event={"ID":"39428403-f0b4-447f-aa88-b83cb0d4b449","Type":"ContainerStarted","Data":"de3ff2780191336292ff3ca25fcb02a9d4f12a6c51555ee9f7c0736c8459261a"} Jun 13 03:53:57.238685 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:57.238661 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:53:57.240397 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:57.240373 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-pzc7m container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 13 03:53:57.240518 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:57.240432 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" podUID="39428403-f0b4-447f-aa88-b83cb0d4b449" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:53:57.260068 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:57.260018 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" podStartSLOduration=1.869575148 podStartE2EDuration="4.260006345s" totalImagesPullingTime="2.390431197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:57.257719814 +0000 UTC m=+588.888382403" watchObservedRunningTime="2026-06-13 03:53:57.260006345 +0000 UTC m=+588.890668933" Jun 13 03:53:58.244135 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:53:58.244095 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-pzc7m" Jun 13 03:54:08.829205 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:08.829169 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 03:54:08.829684 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:08.829252 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 03:54:36.619201 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.618701 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-758df4989-clfpz"] Jun 13 03:54:36.623261 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.623243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.627330 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.627119 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7kzdx\"" Jun 13 03:54:36.627330 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.627135 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 03:54:36.627330 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.627145 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 03:54:36.627330 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.627206 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 03:54:36.627628 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.627464 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 03:54:36.627749 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.627730 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 03:54:36.632470 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.632450 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 13 03:54:36.639565 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.639544 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758df4989-clfpz"] Jun 13 03:54:36.749873 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.749846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-console-config\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.750004 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.749889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-oauth-serving-cert\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.750004 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.749956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11507190-723b-4767-9170-19e800680b3a-console-serving-cert\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.750004 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.750000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11507190-723b-4767-9170-19e800680b3a-console-oauth-config\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.750150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.750037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-service-ca\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.750150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.750060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-trusted-ca-bundle\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.750150 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.750098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljmd4\" (UniqueName: \"kubernetes.io/projected/11507190-723b-4767-9170-19e800680b3a-kube-api-access-ljmd4\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.850779 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.850747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-console-config\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.850930 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.850790 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-oauth-serving-cert\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.850930 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.850815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11507190-723b-4767-9170-19e800680b3a-console-serving-cert\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.851051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.850941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11507190-723b-4767-9170-19e800680b3a-console-oauth-config\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.851051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.851001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-service-ca\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.851051 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.851027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-trusted-ca-bundle\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.851235 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.851079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljmd4\" (UniqueName: \"kubernetes.io/projected/11507190-723b-4767-9170-19e800680b3a-kube-api-access-ljmd4\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.851647 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.851573 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-console-config\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.851853 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.851833 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-service-ca\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.852219 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.852192 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-oauth-serving-cert\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.852310 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.852283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11507190-723b-4767-9170-19e800680b3a-trusted-ca-bundle\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.853611 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.853586 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11507190-723b-4767-9170-19e800680b3a-console-oauth-config\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.853690 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.853619 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11507190-723b-4767-9170-19e800680b3a-console-serving-cert\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.859975 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.859955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljmd4\" (UniqueName: \"kubernetes.io/projected/11507190-723b-4767-9170-19e800680b3a-kube-api-access-ljmd4\") pod \"console-758df4989-clfpz\" (UID: \"11507190-723b-4767-9170-19e800680b3a\") " pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:36.934653 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:36.934635 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:37.069677 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:37.069651 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758df4989-clfpz"] Jun 13 03:54:37.071803 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:54:37.071772 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11507190_723b_4767_9170_19e800680b3a.slice/crio-6ec25903b2f6db1826ce89fcda0416474bdc4be0f513f70dd1a295ee8b668f39 WatchSource:0}: Error finding container 6ec25903b2f6db1826ce89fcda0416474bdc4be0f513f70dd1a295ee8b668f39: Status 404 returned error can't find the container with id 6ec25903b2f6db1826ce89fcda0416474bdc4be0f513f70dd1a295ee8b668f39 Jun 13 03:54:37.429278 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:37.429190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758df4989-clfpz" event={"ID":"11507190-723b-4767-9170-19e800680b3a","Type":"ContainerStarted","Data":"2a3e60a52eb98072b0bdfdafdfe5c9593a77d28f02b18f991a063bf789da97c9"} Jun 13 03:54:37.429278 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:37.429239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758df4989-clfpz" event={"ID":"11507190-723b-4767-9170-19e800680b3a","Type":"ContainerStarted","Data":"6ec25903b2f6db1826ce89fcda0416474bdc4be0f513f70dd1a295ee8b668f39"} Jun 13 03:54:37.448333 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:37.448286 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-758df4989-clfpz" podStartSLOduration=1.448271986 podStartE2EDuration="1.448271986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:54:37.447251329 +0000 UTC m=+629.077913921" watchObservedRunningTime="2026-06-13 03:54:37.448271986 +0000 UTC m=+629.078934574" Jun 13 03:54:40.109616 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.109579 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd"] Jun 13 03:54:40.113142 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.113104 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" Jun 13 03:54:40.115768 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.115745 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 13 03:54:40.115882 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.115817 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 03:54:40.116936 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.116919 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7d6h6\"" Jun 13 03:54:40.116936 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.116928 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 03:54:40.122927 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.122905 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd"] Jun 13 03:54:40.179151 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.179110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2kzb\" (UniqueName: \"kubernetes.io/projected/991ca5f3-8d48-4150-912a-37b90660ad1f-kube-api-access-r2kzb\") pod \"dns-operator-controller-manager-864dd78c4c-7x7dd\" (UID: \"991ca5f3-8d48-4150-912a-37b90660ad1f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" Jun 13 03:54:40.280228 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.280203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2kzb\" (UniqueName: \"kubernetes.io/projected/991ca5f3-8d48-4150-912a-37b90660ad1f-kube-api-access-r2kzb\") pod \"dns-operator-controller-manager-864dd78c4c-7x7dd\" (UID: \"991ca5f3-8d48-4150-912a-37b90660ad1f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" Jun 13 03:54:40.293809 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.293784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2kzb\" (UniqueName: \"kubernetes.io/projected/991ca5f3-8d48-4150-912a-37b90660ad1f-kube-api-access-r2kzb\") pod \"dns-operator-controller-manager-864dd78c4c-7x7dd\" (UID: \"991ca5f3-8d48-4150-912a-37b90660ad1f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" Jun 13 03:54:40.426047 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.425947 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" Jun 13 03:54:40.568743 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.568720 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd"] Jun 13 03:54:40.570847 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:54:40.570815 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991ca5f3_8d48_4150_912a_37b90660ad1f.slice/crio-5f0770f9304f0dbafaf19f477916091b09a687d15d94ab2ef575b619e12b5d14 WatchSource:0}: Error finding container 5f0770f9304f0dbafaf19f477916091b09a687d15d94ab2ef575b619e12b5d14: Status 404 returned error can't find the container with id 5f0770f9304f0dbafaf19f477916091b09a687d15d94ab2ef575b619e12b5d14 Jun 13 03:54:40.572908 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:40.572890 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 03:54:41.453925 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:41.453840 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" event={"ID":"991ca5f3-8d48-4150-912a-37b90660ad1f","Type":"ContainerStarted","Data":"5f0770f9304f0dbafaf19f477916091b09a687d15d94ab2ef575b619e12b5d14"} Jun 13 03:54:43.465375 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:43.465340 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" event={"ID":"991ca5f3-8d48-4150-912a-37b90660ad1f","Type":"ContainerStarted","Data":"31517aaa6d167cc385f0aed3e718dee8ed7ce213199e4febe598b585c5ac8408"} Jun 13 03:54:43.465867 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:43.465479 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" Jun 13 03:54:43.487331 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:43.487286 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" podStartSLOduration=1.215545548 podStartE2EDuration="3.487272794s" totalImagesPullingTime="2.271727246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:54:43.486168673 +0000 UTC m=+635.116831289" watchObservedRunningTime="2026-06-13 03:54:43.487272794 +0000 UTC m=+635.117935382" Jun 13 03:54:46.935662 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:46.935634 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:46.936019 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:46.935704 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:46.940167 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:46.940139 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:47.488408 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:47.488381 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-758df4989-clfpz" Jun 13 03:54:49.152380 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:49.152319 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn"] Jun 13 03:54:49.156042 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:49.156025 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:54:49.158568 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:49.158552 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f277c\"" Jun 13 03:54:49.167455 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:49.167432 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn"] Jun 13 03:54:49.254845 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:49.254819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxvt\" (UniqueName: \"kubernetes.io/projected/e57e696c-f8b4-409d-bdf3-15075896341e-kube-api-access-2mxvt\") pod \"limitador-operator-controller-manager-859d7b78bd-nm6gn\" (UID: \"e57e696c-f8b4-409d-bdf3-15075896341e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:54:49.355522 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:49.355489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxvt\" (UniqueName: \"kubernetes.io/projected/e57e696c-f8b4-409d-bdf3-15075896341e-kube-api-access-2mxvt\") pod \"limitador-operator-controller-manager-859d7b78bd-nm6gn\" (UID: \"e57e696c-f8b4-409d-bdf3-15075896341e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:54:49.370592 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:49.370555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxvt\" (UniqueName: \"kubernetes.io/projected/e57e696c-f8b4-409d-bdf3-15075896341e-kube-api-access-2mxvt\") pod \"limitador-operator-controller-manager-859d7b78bd-nm6gn\" (UID: \"e57e696c-f8b4-409d-bdf3-15075896341e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:54:49.466498 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:49.466465 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:54:49.602305 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:49.602279 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn"] Jun 13 03:54:49.605056 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:54:49.605030 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57e696c_f8b4_409d_bdf3_15075896341e.slice/crio-1efb8455cf59f5255b5f3119191a7dbad8d3b06fa04d842c58234c4129e6ae3a WatchSource:0}: Error finding container 1efb8455cf59f5255b5f3119191a7dbad8d3b06fa04d842c58234c4129e6ae3a: Status 404 returned error can't find the container with id 1efb8455cf59f5255b5f3119191a7dbad8d3b06fa04d842c58234c4129e6ae3a Jun 13 03:54:50.501465 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:50.501424 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" event={"ID":"e57e696c-f8b4-409d-bdf3-15075896341e","Type":"ContainerStarted","Data":"1efb8455cf59f5255b5f3119191a7dbad8d3b06fa04d842c58234c4129e6ae3a"} Jun 13 03:54:52.517718 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:52.517682 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" event={"ID":"e57e696c-f8b4-409d-bdf3-15075896341e","Type":"ContainerStarted","Data":"e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78"} Jun 13 03:54:52.518102 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:52.517761 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:54:52.534747 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:52.534705 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" podStartSLOduration=1.625757332 podStartE2EDuration="3.534692523s" totalImagesPullingTime="1.908935191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:54:52.534529205 +0000 UTC m=+644.165191814" watchObservedRunningTime="2026-06-13 03:54:52.534692523 +0000 UTC m=+644.165355094" Jun 13 03:54:54.472279 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:54:54.472248 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7x7dd" Jun 13 03:55:03.525112 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:03.525083 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:55:05.526801 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.526765 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn"] Jun 13 03:55:05.527249 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.526987 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" containerName="manager" containerID="cri-o://e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78" gracePeriod=2 Jun 13 03:55:05.539153 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.539117 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn"] Jun 13 03:55:05.539615 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:55:05.539574 2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e57e696c-f8b4-409d-bdf3-15075896341e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-nm6gn\": pods \"limitador-operator-controller-manager-859d7b78bd-nm6gn\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:55:05.554174 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.554149 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq"] Jun 13 03:55:05.554738 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.554723 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" containerName="manager" Jun 13 03:55:05.554795 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.554742 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" containerName="manager" Jun 13 03:55:05.554848 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.554836 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" containerName="manager" Jun 13 03:55:05.558211 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.558189 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" Jun 13 03:55:05.560571 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:55:05.560545 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nm6gn\" is forbidden: User \"system:node:ip-10-0-133-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-206.ec2.internal' and this object" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:55:05.567303 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.567280 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq"] Jun 13 03:55:05.693240 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.693205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4ccf\" (UniqueName: \"kubernetes.io/projected/3b1abbe0-0bea-4eaf-a4ea-3ca416044f53-kube-api-access-v4ccf\") pod \"limitador-operator-controller-manager-859d7b78bd-5srbq\" (UID: \"3b1abbe0-0bea-4eaf-a4ea-3ca416044f53\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" Jun 13 03:55:05.775004 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.774981 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:55:05.778205 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:55:05.778149 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nm6gn\" is forbidden: User \"system:node:ip-10-0-133-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-206.ec2.internal' and this object" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:55:05.794571 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.794547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4ccf\" (UniqueName: \"kubernetes.io/projected/3b1abbe0-0bea-4eaf-a4ea-3ca416044f53-kube-api-access-v4ccf\") pod \"limitador-operator-controller-manager-859d7b78bd-5srbq\" (UID: \"3b1abbe0-0bea-4eaf-a4ea-3ca416044f53\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" Jun 13 03:55:05.812335 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.812310 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4ccf\" (UniqueName: \"kubernetes.io/projected/3b1abbe0-0bea-4eaf-a4ea-3ca416044f53-kube-api-access-v4ccf\") pod \"limitador-operator-controller-manager-859d7b78bd-5srbq\" (UID: \"3b1abbe0-0bea-4eaf-a4ea-3ca416044f53\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" Jun 13 03:55:05.895061 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.895038 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mxvt\" (UniqueName: \"kubernetes.io/projected/e57e696c-f8b4-409d-bdf3-15075896341e-kube-api-access-2mxvt\") pod \"e57e696c-f8b4-409d-bdf3-15075896341e\" (UID: \"e57e696c-f8b4-409d-bdf3-15075896341e\") " Jun 13 03:55:05.897174 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.897153 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57e696c-f8b4-409d-bdf3-15075896341e-kube-api-access-2mxvt" (OuterVolumeSpecName: "kube-api-access-2mxvt") pod "e57e696c-f8b4-409d-bdf3-15075896341e" (UID: "e57e696c-f8b4-409d-bdf3-15075896341e"). InnerVolumeSpecName "kube-api-access-2mxvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:55:05.924421 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.924397 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" Jun 13 03:55:05.999976 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:05.996789 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mxvt\" (UniqueName: \"kubernetes.io/projected/e57e696c-f8b4-409d-bdf3-15075896341e-kube-api-access-2mxvt\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 03:55:06.064289 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.064225 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq"] Jun 13 03:55:06.066539 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:55:06.066511 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1abbe0_0bea_4eaf_a4ea_3ca416044f53.slice/crio-60bf8d4dd64024b8eef4af828fb46311ab1eb396d15111ae7d0955801a579997 WatchSource:0}: Error finding container 60bf8d4dd64024b8eef4af828fb46311ab1eb396d15111ae7d0955801a579997: Status 404 returned error can't find the container with id 60bf8d4dd64024b8eef4af828fb46311ab1eb396d15111ae7d0955801a579997 Jun 13 03:55:06.591088 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.591052 2574 generic.go:356] "Generic (PLEG): container finished" podID="e57e696c-f8b4-409d-bdf3-15075896341e" containerID="e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78" exitCode=0 Jun 13 03:55:06.591488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.591144 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:55:06.591488 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.591157 2574 scope.go:117] "RemoveContainer" containerID="e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78" Jun 13 03:55:06.592840 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.592815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" event={"ID":"3b1abbe0-0bea-4eaf-a4ea-3ca416044f53","Type":"ContainerStarted","Data":"376409791ceb366e72ebf937f1c8ef32849ba1c07d5c01bfdedfd7e8fc65ffad"} Jun 13 03:55:06.592923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.592874 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" Jun 13 03:55:06.592923 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.592899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" event={"ID":"3b1abbe0-0bea-4eaf-a4ea-3ca416044f53","Type":"ContainerStarted","Data":"60bf8d4dd64024b8eef4af828fb46311ab1eb396d15111ae7d0955801a579997"} Jun 13 03:55:06.593810 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:55:06.593785 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nm6gn\" is forbidden: User \"system:node:ip-10-0-133-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-206.ec2.internal' and this object" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:55:06.600185 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.600168 2574 scope.go:117] "RemoveContainer" containerID="e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78" Jun 13 03:55:06.600433 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:55:06.600418 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78\": container with ID starting with e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78 not found: ID does not exist" containerID="e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78" Jun 13 03:55:06.600482 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.600440 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78"} err="failed to get container status \"e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78\": rpc error: code = NotFound desc = could not find container \"e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78\": container with ID starting with e6f470eb6e0228b730d201abd507f5bc76cc39c4541b25e7fc9b9ce09a883d78 not found: ID does not exist" Jun 13 03:55:06.613188 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.613146 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" podStartSLOduration=1.613108236 podStartE2EDuration="1.613108236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:55:06.611257984 +0000 UTC m=+658.241920573" watchObservedRunningTime="2026-06-13 03:55:06.613108236 +0000 UTC m=+658.243770890" Jun 13 03:55:06.613360 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:55:06.613336 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nm6gn\" is forbidden: User \"system:node:ip-10-0-133-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-206.ec2.internal' and this object" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:55:06.615487 ip-10-0-133-206 kubenswrapper[2574]: E0613 03:55:06.615464 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nm6gn\" is forbidden: User \"system:node:ip-10-0-133-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-206.ec2.internal' and this object" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nm6gn" Jun 13 03:55:06.849809 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:06.849736 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57e696c-f8b4-409d-bdf3-15075896341e" path="/var/lib/kubelet/pods/e57e696c-f8b4-409d-bdf3-15075896341e/volumes" Jun 13 03:55:17.601447 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:17.601413 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5srbq" Jun 13 03:55:50.352684 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.352649 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 03:55:50.356354 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.356337 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:55:50.358940 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.358922 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hxt6z\"" Jun 13 03:55:50.359070 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.358975 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 13 03:55:50.362819 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.362798 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 03:55:50.386799 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.386770 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 03:55:50.446480 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.446451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4df1a02d-1a8d-42df-9717-6877418aa4e5-config-file\") pod \"limitador-limitador-54d6d988d5-2bzbh\" (UID: \"4df1a02d-1a8d-42df-9717-6877418aa4e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:55:50.446598 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.446502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2klc\" (UniqueName: \"kubernetes.io/projected/4df1a02d-1a8d-42df-9717-6877418aa4e5-kube-api-access-f2klc\") pod \"limitador-limitador-54d6d988d5-2bzbh\" (UID: \"4df1a02d-1a8d-42df-9717-6877418aa4e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:55:50.547416 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.547374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4df1a02d-1a8d-42df-9717-6877418aa4e5-config-file\") pod \"limitador-limitador-54d6d988d5-2bzbh\" (UID: \"4df1a02d-1a8d-42df-9717-6877418aa4e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:55:50.547572 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.547444 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2klc\" (UniqueName: \"kubernetes.io/projected/4df1a02d-1a8d-42df-9717-6877418aa4e5-kube-api-access-f2klc\") pod \"limitador-limitador-54d6d988d5-2bzbh\" (UID: \"4df1a02d-1a8d-42df-9717-6877418aa4e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:55:50.547984 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.547961 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4df1a02d-1a8d-42df-9717-6877418aa4e5-config-file\") pod \"limitador-limitador-54d6d988d5-2bzbh\" (UID: \"4df1a02d-1a8d-42df-9717-6877418aa4e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:55:50.555173 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.555155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2klc\" (UniqueName: \"kubernetes.io/projected/4df1a02d-1a8d-42df-9717-6877418aa4e5-kube-api-access-f2klc\") pod \"limitador-limitador-54d6d988d5-2bzbh\" (UID: \"4df1a02d-1a8d-42df-9717-6877418aa4e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:55:50.668330 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.668251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:55:50.802092 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:50.802054 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 03:55:50.802611 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:55:50.802586 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df1a02d_1a8d_42df_9717_6877418aa4e5.slice/crio-71049d21e76b1d346f82096e5bf40ae0a0429632b6d6425b8a94736455ec7c25 WatchSource:0}: Error finding container 71049d21e76b1d346f82096e5bf40ae0a0429632b6d6425b8a94736455ec7c25: Status 404 returned error can't find the container with id 71049d21e76b1d346f82096e5bf40ae0a0429632b6d6425b8a94736455ec7c25 Jun 13 03:55:51.814423 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:51.814383 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" event={"ID":"4df1a02d-1a8d-42df-9717-6877418aa4e5","Type":"ContainerStarted","Data":"71049d21e76b1d346f82096e5bf40ae0a0429632b6d6425b8a94736455ec7c25"} Jun 13 03:55:53.828260 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:53.828181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" event={"ID":"4df1a02d-1a8d-42df-9717-6877418aa4e5","Type":"ContainerStarted","Data":"c340c47bcf8c0001028ab08ffc547406e0670db4cde43170ef2e40d6a8544721"} Jun 13 03:55:53.828586 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:53.828333 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:55:53.844908 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:55:53.844841 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" podStartSLOduration=1.205991633 podStartE2EDuration="3.844824358s" totalImagesPullingTime="2.638832725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:55:53.844189591 +0000 UTC m=+705.474852182" watchObservedRunningTime="2026-06-13 03:55:53.844824358 +0000 UTC m=+705.475486946" Jun 13 03:56:04.833782 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:56:04.833708 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2bzbh" Jun 13 03:57:51.565047 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:51.565011 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8pvtd"] Jun 13 03:57:51.567409 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:51.567393 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" Jun 13 03:57:51.569835 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:51.569812 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 13 03:57:51.578158 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:51.578136 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8pvtd"] Jun 13 03:57:51.643038 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:51.643008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xthr\" (UniqueName: \"kubernetes.io/projected/b4980bfb-8203-4328-9ddb-4c737d89f31e-kube-api-access-6xthr\") pod \"payload-pre-processing-579785bc64-8pvtd\" (UID: \"b4980bfb-8203-4328-9ddb-4c737d89f31e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" Jun 13 03:57:51.668204 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:51.668173 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 03:57:51.744286 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:51.744248 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xthr\" (UniqueName: \"kubernetes.io/projected/b4980bfb-8203-4328-9ddb-4c737d89f31e-kube-api-access-6xthr\") pod \"payload-pre-processing-579785bc64-8pvtd\" (UID: \"b4980bfb-8203-4328-9ddb-4c737d89f31e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" Jun 13 03:57:51.753201 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:51.753178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xthr\" (UniqueName: \"kubernetes.io/projected/b4980bfb-8203-4328-9ddb-4c737d89f31e-kube-api-access-6xthr\") pod \"payload-pre-processing-579785bc64-8pvtd\" (UID: \"b4980bfb-8203-4328-9ddb-4c737d89f31e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" Jun 13 03:57:51.878459 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:51.878388 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" Jun 13 03:57:52.008298 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:52.008274 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8pvtd"] Jun 13 03:57:52.010493 ip-10-0-133-206 kubenswrapper[2574]: W0613 03:57:52.010469 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4980bfb_8203_4328_9ddb_4c737d89f31e.slice/crio-371fa0a0572b55af477ea8545d03ac9a7807400609d945f900c7546be017cd4b WatchSource:0}: Error finding container 371fa0a0572b55af477ea8545d03ac9a7807400609d945f900c7546be017cd4b: Status 404 returned error can't find the container with id 371fa0a0572b55af477ea8545d03ac9a7807400609d945f900c7546be017cd4b Jun 13 03:57:52.404320 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:52.404289 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" event={"ID":"b4980bfb-8203-4328-9ddb-4c737d89f31e","Type":"ContainerStarted","Data":"371fa0a0572b55af477ea8545d03ac9a7807400609d945f900c7546be017cd4b"} Jun 13 03:57:54.417509 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:54.417471 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" event={"ID":"b4980bfb-8203-4328-9ddb-4c737d89f31e","Type":"ContainerStarted","Data":"96d07196499429842bfca9701ac60823035931185b61a0e37d6e6305d98f0980"} Jun 13 03:57:54.417957 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:54.417612 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" Jun 13 03:57:54.433116 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:57:54.433071 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" podStartSLOduration=1.253952342 podStartE2EDuration="3.433056371s" totalImagesPullingTime="2.179104029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:57:54.431711761 +0000 UTC m=+826.062374349" watchObservedRunningTime="2026-06-13 03:57:54.433056371 +0000 UTC m=+826.063718959" Jun 13 03:58:05.424673 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:58:05.424641 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-8pvtd" Jun 13 03:59:08.876303 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:59:08.876275 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 03:59:08.877709 ip-10-0-133-206 kubenswrapper[2574]: I0613 03:59:08.877688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 04:00:00.141266 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.141233 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688720-s4sbr"] Jun 13 04:00:00.144562 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.144545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" Jun 13 04:00:00.147010 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.146991 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jdvq2\"" Jun 13 04:00:00.160311 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.160284 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688720-s4sbr"] Jun 13 04:00:00.274542 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.274507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7sdq\" (UniqueName: \"kubernetes.io/projected/e77d92d3-514c-4e48-8877-21261ecec4d9-kube-api-access-x7sdq\") pod \"maas-api-key-cleanup-29688720-s4sbr\" (UID: \"e77d92d3-514c-4e48-8877-21261ecec4d9\") " pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" Jun 13 04:00:00.375568 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.375534 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7sdq\" (UniqueName: \"kubernetes.io/projected/e77d92d3-514c-4e48-8877-21261ecec4d9-kube-api-access-x7sdq\") pod \"maas-api-key-cleanup-29688720-s4sbr\" (UID: \"e77d92d3-514c-4e48-8877-21261ecec4d9\") " pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" Jun 13 04:00:00.383611 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.383589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7sdq\" (UniqueName: \"kubernetes.io/projected/e77d92d3-514c-4e48-8877-21261ecec4d9-kube-api-access-x7sdq\") pod \"maas-api-key-cleanup-29688720-s4sbr\" (UID: \"e77d92d3-514c-4e48-8877-21261ecec4d9\") " pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" Jun 13 04:00:00.454876 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.454854 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" Jun 13 04:00:00.587878 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.587852 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688720-s4sbr"] Jun 13 04:00:00.589620 ip-10-0-133-206 kubenswrapper[2574]: W0613 04:00:00.589592 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77d92d3_514c_4e48_8877_21261ecec4d9.slice/crio-cff9deb5627caf24d61dae2e8ca90102c349aac6dbd26dceed29a697563aaaa6 WatchSource:0}: Error finding container cff9deb5627caf24d61dae2e8ca90102c349aac6dbd26dceed29a697563aaaa6: Status 404 returned error can't find the container with id cff9deb5627caf24d61dae2e8ca90102c349aac6dbd26dceed29a697563aaaa6 Jun 13 04:00:00.591579 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:00.591561 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 04:00:01.066097 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:01.066065 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" event={"ID":"e77d92d3-514c-4e48-8877-21261ecec4d9","Type":"ContainerStarted","Data":"cff9deb5627caf24d61dae2e8ca90102c349aac6dbd26dceed29a697563aaaa6"} Jun 13 04:00:04.085309 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:04.085262 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" event={"ID":"e77d92d3-514c-4e48-8877-21261ecec4d9","Type":"ContainerStarted","Data":"0c78bddbb353f7b689dfa810b3d54d55b231776c8e2f8ad29038108ca0da23bc"} Jun 13 04:00:04.101243 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:04.101199 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" podStartSLOduration=1.366132074 podStartE2EDuration="4.101185346s" totalImagesPullingTime="2.735053272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 04:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 04:00:04.099082717 +0000 UTC m=+955.729745306" watchObservedRunningTime="2026-06-13 04:00:04.101185346 +0000 UTC m=+955.731847935" Jun 13 04:00:05.091894 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:05.091855 2574 generic.go:356] "Generic (PLEG): container finished" podID="e77d92d3-514c-4e48-8877-21261ecec4d9" containerID="0c78bddbb353f7b689dfa810b3d54d55b231776c8e2f8ad29038108ca0da23bc" exitCode=0 Jun 13 04:00:05.092288 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:05.091933 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" event={"ID":"e77d92d3-514c-4e48-8877-21261ecec4d9","Type":"ContainerDied","Data":"0c78bddbb353f7b689dfa810b3d54d55b231776c8e2f8ad29038108ca0da23bc"} Jun 13 04:00:06.232737 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:06.232707 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" Jun 13 04:00:06.328187 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:06.328160 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7sdq\" (UniqueName: \"kubernetes.io/projected/e77d92d3-514c-4e48-8877-21261ecec4d9-kube-api-access-x7sdq\") pod \"e77d92d3-514c-4e48-8877-21261ecec4d9\" (UID: \"e77d92d3-514c-4e48-8877-21261ecec4d9\") " Jun 13 04:00:06.330313 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:06.330289 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e77d92d3-514c-4e48-8877-21261ecec4d9-kube-api-access-x7sdq" (OuterVolumeSpecName: "kube-api-access-x7sdq") pod "e77d92d3-514c-4e48-8877-21261ecec4d9" (UID: "e77d92d3-514c-4e48-8877-21261ecec4d9"). InnerVolumeSpecName "kube-api-access-x7sdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 04:00:06.429247 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:06.429189 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7sdq\" (UniqueName: \"kubernetes.io/projected/e77d92d3-514c-4e48-8877-21261ecec4d9-kube-api-access-x7sdq\") on node \"ip-10-0-133-206.ec2.internal\" DevicePath \"\"" Jun 13 04:00:07.104546 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:07.104513 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" event={"ID":"e77d92d3-514c-4e48-8877-21261ecec4d9","Type":"ContainerDied","Data":"cff9deb5627caf24d61dae2e8ca90102c349aac6dbd26dceed29a697563aaaa6"} Jun 13 04:00:07.104546 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:07.104530 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688720-s4sbr" Jun 13 04:00:07.104742 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:07.104563 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cff9deb5627caf24d61dae2e8ca90102c349aac6dbd26dceed29a697563aaaa6" Jun 13 04:00:51.970262 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:00:51.970220 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 04:01:00.024630 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.024595 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx"] Jun 13 04:01:00.025055 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.024997 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e77d92d3-514c-4e48-8877-21261ecec4d9" containerName="cleanup" Jun 13 04:01:00.025055 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.025009 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e77d92d3-514c-4e48-8877-21261ecec4d9" containerName="cleanup" Jun 13 04:01:00.025151 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.025091 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e77d92d3-514c-4e48-8877-21261ecec4d9" containerName="cleanup" Jun 13 04:01:00.028263 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.028242 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.032218 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.032194 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 04:01:00.032329 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.032266 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f2g9b\"" Jun 13 04:01:00.037430 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.037409 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 13 04:01:00.037938 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.037922 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 04:01:00.048300 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.048280 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx"] Jun 13 04:01:00.160072 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.160040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.160240 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.160097 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.160240 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.160113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.160240 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.160165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ckrp\" (UniqueName: \"kubernetes.io/projected/857943fd-ff82-448c-9e6d-54e4b061d9c9-kube-api-access-4ckrp\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.160240 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.160195 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/857943fd-ff82-448c-9e6d-54e4b061d9c9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.160240 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.160215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.261249 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.261217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.261389 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.261280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.261389 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.261337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.261389 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.261356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.261519 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.261389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ckrp\" (UniqueName: \"kubernetes.io/projected/857943fd-ff82-448c-9e6d-54e4b061d9c9-kube-api-access-4ckrp\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.261570 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.261518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/857943fd-ff82-448c-9e6d-54e4b061d9c9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.261629 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.261608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.261688 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.261669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.261754 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.261734 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.263553 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.263535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/857943fd-ff82-448c-9e6d-54e4b061d9c9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.263950 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.263927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/857943fd-ff82-448c-9e6d-54e4b061d9c9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.269025 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.269002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ckrp\" (UniqueName: \"kubernetes.io/projected/857943fd-ff82-448c-9e6d-54e4b061d9c9-kube-api-access-4ckrp\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9g4sx\" (UID: \"857943fd-ff82-448c-9e6d-54e4b061d9c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.338878 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.338819 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:01:00.467370 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.467330 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 04:01:00.477725 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:00.477704 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx"] Jun 13 04:01:00.480338 ip-10-0-133-206 kubenswrapper[2574]: W0613 04:01:00.480308 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod857943fd_ff82_448c_9e6d_54e4b061d9c9.slice/crio-71b23ce2f518a6e2ec9022254fabe25a73929f6065348d38eac5f894dd8dae0d WatchSource:0}: Error finding container 71b23ce2f518a6e2ec9022254fabe25a73929f6065348d38eac5f894dd8dae0d: Status 404 returned error can't find the container with id 71b23ce2f518a6e2ec9022254fabe25a73929f6065348d38eac5f894dd8dae0d Jun 13 04:01:01.380325 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:01.380289 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" event={"ID":"857943fd-ff82-448c-9e6d-54e4b061d9c9","Type":"ContainerStarted","Data":"71b23ce2f518a6e2ec9022254fabe25a73929f6065348d38eac5f894dd8dae0d"} Jun 13 04:01:04.404689 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:04.404648 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" event={"ID":"857943fd-ff82-448c-9e6d-54e4b061d9c9","Type":"ContainerStarted","Data":"7daa38b5cfeb6ac193de5939f8bf4d2d568a84087745e15a88f5bd527f0dc44a"} Jun 13 04:01:27.685564 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.685524 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx"] Jun 13 04:01:27.707658 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.707633 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx"] Jun 13 04:01:27.707798 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.707724 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.710222 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.710199 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 13 04:01:27.796691 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.796664 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.796691 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.796691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b2c8fa-5777-47e4-894b-509847c4a46c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.796882 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.796768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.796882 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.796803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.796985 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.796874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpv8h\" (UniqueName: \"kubernetes.io/projected/e5b2c8fa-5777-47e4-894b-509847c4a46c-kube-api-access-tpv8h\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.796985 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.796910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.897577 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.897550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.897726 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.897592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.897726 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.897643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpv8h\" (UniqueName: \"kubernetes.io/projected/e5b2c8fa-5777-47e4-894b-509847c4a46c-kube-api-access-tpv8h\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.897726 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.897669 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.897899 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.897747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.897899 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.897769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b2c8fa-5777-47e4-894b-509847c4a46c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.897993 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.897953 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.898050 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.898015 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.898106 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.898066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.899980 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.899958 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5b2c8fa-5777-47e4-894b-509847c4a46c-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.900250 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.900231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b2c8fa-5777-47e4-894b-509847c4a46c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:27.905452 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:27.905432 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpv8h\" (UniqueName: \"kubernetes.io/projected/e5b2c8fa-5777-47e4-894b-509847c4a46c-kube-api-access-tpv8h\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx\" (UID: \"e5b2c8fa-5777-47e4-894b-509847c4a46c\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:28.018139 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:28.018066 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:28.148548 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:28.148519 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx"] Jun 13 04:01:28.150355 ip-10-0-133-206 kubenswrapper[2574]: W0613 04:01:28.150328 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b2c8fa_5777_47e4_894b_509847c4a46c.slice/crio-b400562948fe553c5e647c5fa66218f2e168d90ce226862d66eb4f53dbe649cf WatchSource:0}: Error finding container b400562948fe553c5e647c5fa66218f2e168d90ce226862d66eb4f53dbe649cf: Status 404 returned error can't find the container with id b400562948fe553c5e647c5fa66218f2e168d90ce226862d66eb4f53dbe649cf Jun 13 04:01:28.335854 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:28.335762 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 04:01:28.531337 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:28.531293 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" event={"ID":"e5b2c8fa-5777-47e4-894b-509847c4a46c","Type":"ContainerStarted","Data":"ae5b4c6e8b7f85b5f410e0c444c471bd693774c087df19d47af67190fd0534fb"} Jun 13 04:01:28.531518 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:28.531353 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" event={"ID":"e5b2c8fa-5777-47e4-894b-509847c4a46c","Type":"ContainerStarted","Data":"b400562948fe553c5e647c5fa66218f2e168d90ce226862d66eb4f53dbe649cf"} Jun 13 04:01:33.558365 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:33.558288 2574 generic.go:356] "Generic (PLEG): container finished" podID="e5b2c8fa-5777-47e4-894b-509847c4a46c" containerID="ae5b4c6e8b7f85b5f410e0c444c471bd693774c087df19d47af67190fd0534fb" exitCode=0 Jun 13 04:01:33.558732 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:33.558363 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" event={"ID":"e5b2c8fa-5777-47e4-894b-509847c4a46c","Type":"ContainerDied","Data":"ae5b4c6e8b7f85b5f410e0c444c471bd693774c087df19d47af67190fd0534fb"} Jun 13 04:01:35.571192 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:35.571158 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" event={"ID":"e5b2c8fa-5777-47e4-894b-509847c4a46c","Type":"ContainerStarted","Data":"d971c5a217414645d3c63be31574c8b8ffe497ea698964580c918324157eb966"} Jun 13 04:01:35.587412 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:35.587359 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" podStartSLOduration=2.116011469 podStartE2EDuration="8.587344157s" totalImagesPullingTime="1.421389348s" totalInitContainerRuntime="5.04994334s" isStatefulPod=false podCreationTimestamp="2026-06-13 04:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 04:01:35.586205935 +0000 UTC m=+1047.216868529" watchObservedRunningTime="2026-06-13 04:01:35.587344157 +0000 UTC m=+1047.218006746" Jun 13 04:01:38.018369 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:38.018340 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:38.018739 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:38.018392 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:38.033324 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:38.033291 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:38.597311 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:38.597280 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx" Jun 13 04:01:45.639303 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:01:45.639268 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 04:02:02.708380 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:02.708346 2574 generic.go:356] "Generic (PLEG): container finished" podID="857943fd-ff82-448c-9e6d-54e4b061d9c9" containerID="7daa38b5cfeb6ac193de5939f8bf4d2d568a84087745e15a88f5bd527f0dc44a" exitCode=0 Jun 13 04:02:02.708380 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:02.708383 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" event={"ID":"857943fd-ff82-448c-9e6d-54e4b061d9c9","Type":"ContainerDied","Data":"7daa38b5cfeb6ac193de5939f8bf4d2d568a84087745e15a88f5bd527f0dc44a"} Jun 13 04:02:03.714870 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:03.714834 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" event={"ID":"857943fd-ff82-448c-9e6d-54e4b061d9c9","Type":"ContainerStarted","Data":"4889ce156cf984c3e801fd060ae4565881cf75d0d3b5bc5444757a793d51a2a5"} Jun 13 04:02:03.733372 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:03.733322 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" podStartSLOduration=3.151005734 podStartE2EDuration="1m4.733307565s" totalImagesPullingTime="3.282460967s" totalInitContainerRuntime="58.299840864s" isStatefulPod=false podCreationTimestamp="2026-06-13 04:00:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 04:02:03.731840145 +0000 UTC m=+1075.362502735" watchObservedRunningTime="2026-06-13 04:02:03.733307565 +0000 UTC m=+1075.363970131" Jun 13 04:02:05.878570 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:05.878531 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx"] Jun 13 04:02:05.885305 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:05.885281 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:05.887781 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:05.887747 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 13 04:02:05.891709 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:05.891689 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx"] Jun 13 04:02:06.013659 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.013628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d644fc02-7668-4724-a98f-08d3cc1369ed-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.013805 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.013687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4z7\" (UniqueName: \"kubernetes.io/projected/d644fc02-7668-4724-a98f-08d3cc1369ed-kube-api-access-tx4z7\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.013856 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.013832 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.013896 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.013861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.013991 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.013967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.014031 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.014012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.115301 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.115273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4z7\" (UniqueName: \"kubernetes.io/projected/d644fc02-7668-4724-a98f-08d3cc1369ed-kube-api-access-tx4z7\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.115481 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.115315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.115481 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.115333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.115481 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.115391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.115481 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.115417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.115481 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.115444 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d644fc02-7668-4724-a98f-08d3cc1369ed-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.115800 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.115773 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.115800 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.115790 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.115997 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.115850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.117425 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.117404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d644fc02-7668-4724-a98f-08d3cc1369ed-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.117669 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.117654 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d644fc02-7668-4724-a98f-08d3cc1369ed-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.123030 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.123011 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4z7\" (UniqueName: \"kubernetes.io/projected/d644fc02-7668-4724-a98f-08d3cc1369ed-kube-api-access-tx4z7\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx\" (UID: \"d644fc02-7668-4724-a98f-08d3cc1369ed\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.198773 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.198748 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" Jun 13 04:02:06.334841 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.334809 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx"] Jun 13 04:02:06.336218 ip-10-0-133-206 kubenswrapper[2574]: W0613 04:02:06.336191 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd644fc02_7668_4724_a98f_08d3cc1369ed.slice/crio-3aa5f64818edc0ce1604df914f7ac09e0ab0855e8c6566cdebf229f7916846f5 WatchSource:0}: Error finding container 3aa5f64818edc0ce1604df914f7ac09e0ab0855e8c6566cdebf229f7916846f5: Status 404 returned error can't find the container with id 3aa5f64818edc0ce1604df914f7ac09e0ab0855e8c6566cdebf229f7916846f5 Jun 13 04:02:06.732448 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.732411 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" event={"ID":"d644fc02-7668-4724-a98f-08d3cc1369ed","Type":"ContainerStarted","Data":"f3a5876d1230e9be6538516395596e1da00d33463083021a3b94d5c7d2ff3f8d"} Jun 13 04:02:06.732601 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.732465 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx" event={"ID":"d644fc02-7668-4724-a98f-08d3cc1369ed","Type":"ContainerStarted","Data":"3aa5f64818edc0ce1604df914f7ac09e0ab0855e8c6566cdebf229f7916846f5"} Jun 13 04:02:06.851755 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:06.851726 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 04:02:10.339164 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:10.339137 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:02:10.339543 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:10.339217 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:02:10.351339 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:10.351316 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:02:10.764610 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:10.764580 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9g4sx" Jun 13 04:02:12.549746 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:02:12.549708 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2bzbh"] Jun 13 04:04:08.909546 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:04:08.909519 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 04:04:08.911833 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:04:08.911811 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 04:05:48.464595 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:48.464563 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx_d644fc02-7668-4724-a98f-08d3cc1369ed/storage-initializer/0.log" Jun 13 04:05:53.902932 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:53.902897 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-b765c74d8-wrcst_2997320f-3207-4c0a-bc09-b0b3cd3c2fbe/nginx/0.log" Jun 13 04:05:54.005244 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:54.005214 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6s6wx_5e65049b-dec5-426c-aa3d-4e6dd2077bee/manager/0.log" Jun 13 04:05:54.118632 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:54.118598 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-k4ml6_a1f21225-2ae4-47b9-a40c-ca199cb5c300/manager/0.log" Jun 13 04:05:54.342824 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:54.342793 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688720-s4sbr_e77d92d3-514c-4e48-8877-21261ecec4d9/cleanup/0.log" Jun 13 04:05:54.563627 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:54.563592 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-gsk6j_72e963f2-757b-4a44-83a1-2d110e55928d/server/0.log" Jun 13 04:05:55.016281 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:55.016248 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8b9444ff-l58kf_315638a9-60d1-41dc-af7e-c4e97f3f18b4/manager/0.log" Jun 13 04:05:55.022874 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:55.022855 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8b9444ff-l58kf_315638a9-60d1-41dc-af7e-c4e97f3f18b4/copy-manifests/0.log" Jun 13 04:05:56.588734 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:56.588701 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7x7dd_991ca5f3-8d48-4150-912a-37b90660ad1f/manager/0.log" Jun 13 04:05:57.032485 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:57.032457 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2bzbh_4df1a02d-1a8d-42df-9717-6877418aa4e5/limitador/0.log" Jun 13 04:05:57.140742 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:57.140715 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5srbq_3b1abbe0-0bea-4eaf-a4ea-3ca416044f53/manager/0.log" Jun 13 04:05:57.584337 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:57.584308 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-pzc7m_39428403-f0b4-447f-aa88-b83cb0d4b449/discovery/0.log" Jun 13 04:05:57.690911 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:57.690871 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-7pj8n_0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb/kube-auth-proxy/0.log" Jun 13 04:05:58.012082 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:58.012053 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8pvtd_b4980bfb-8203-4328-9ddb-4c737d89f31e/payload-pre-processing/0.log" Jun 13 04:05:58.685160 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:58.685103 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9g4sx_857943fd-ff82-448c-9e6d-54e4b061d9c9/storage-initializer/0.log" Jun 13 04:05:58.691805 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:58.691782 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9g4sx_857943fd-ff82-448c-9e6d-54e4b061d9c9/main/0.log" Jun 13 04:05:58.804601 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:58.804565 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx_e5b2c8fa-5777-47e4-894b-509847c4a46c/storage-initializer/0.log" Jun 13 04:05:58.810963 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:58.810945 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-df5rx_e5b2c8fa-5777-47e4-894b-509847c4a46c/main/0.log" Jun 13 04:05:59.032073 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:05:59.031988 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2ncxx_d644fc02-7668-4724-a98f-08d3cc1369ed/storage-initializer/0.log" Jun 13 04:06:06.037256 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:06.037228 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vzccg_5c43ac6a-27cd-4733-8c96-05f58f2bdbd8/global-pull-secret-syncer/0.log" Jun 13 04:06:06.125244 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:06.125220 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xmwfg_5cb1671c-17d2-4347-a634-a77e1c7559fe/konnectivity-agent/0.log" Jun 13 04:06:06.141943 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:06.141922 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-206.ec2.internal_0c9771c6251e91aa8a81206e3d563d1b/haproxy/0.log" Jun 13 04:06:10.228978 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:10.228943 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-48qbn_cf8f4967-fe5b-4562-a6ef-849b57eeb0dd/sail-operator/0.log" Jun 13 04:06:11.208604 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:11.208571 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7x7dd_991ca5f3-8d48-4150-912a-37b90660ad1f/manager/0.log" Jun 13 04:06:11.331922 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:11.331898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2bzbh_4df1a02d-1a8d-42df-9717-6877418aa4e5/limitador/0.log" Jun 13 04:06:11.357599 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:11.357578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5srbq_3b1abbe0-0bea-4eaf-a4ea-3ca416044f53/manager/0.log" Jun 13 04:06:13.023106 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.023068 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30ba7379-a88a-4393-ae8f-2ab049d5dbe5/alertmanager/0.log" Jun 13 04:06:13.049682 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.049661 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30ba7379-a88a-4393-ae8f-2ab049d5dbe5/config-reloader/0.log" Jun 13 04:06:13.076242 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.076219 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30ba7379-a88a-4393-ae8f-2ab049d5dbe5/kube-rbac-proxy-web/0.log" Jun 13 04:06:13.097643 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.097620 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30ba7379-a88a-4393-ae8f-2ab049d5dbe5/kube-rbac-proxy/0.log" Jun 13 04:06:13.123519 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.123500 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30ba7379-a88a-4393-ae8f-2ab049d5dbe5/kube-rbac-proxy-metric/0.log" Jun 13 04:06:13.146885 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.146865 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30ba7379-a88a-4393-ae8f-2ab049d5dbe5/prom-label-proxy/0.log" Jun 13 04:06:13.172809 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.172791 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_30ba7379-a88a-4393-ae8f-2ab049d5dbe5/init-config-reloader/0.log" Jun 13 04:06:13.593810 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.593782 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhzjp_38f579ae-addd-41d7-986f-9dcd4d05b9d3/node-exporter/0.log" Jun 13 04:06:13.617657 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.617633 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhzjp_38f579ae-addd-41d7-986f-9dcd4d05b9d3/kube-rbac-proxy/0.log" Jun 13 04:06:13.644492 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.644475 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mhzjp_38f579ae-addd-41d7-986f-9dcd4d05b9d3/init-textfile/0.log" Jun 13 04:06:13.685834 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.685817 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-k2q9w_b480708d-72d2-4632-8e70-16ab1bfd317e/kube-rbac-proxy-main/0.log" Jun 13 04:06:13.709517 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.709458 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-k2q9w_b480708d-72d2-4632-8e70-16ab1bfd317e/kube-rbac-proxy-self/0.log" Jun 13 04:06:13.729810 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:13.729794 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-k2q9w_b480708d-72d2-4632-8e70-16ab1bfd317e/openshift-state-metrics/0.log" Jun 13 04:06:14.068332 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:14.068258 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-97895659f-fdzh7_7d790ce5-6339-4fcf-9e86-97dbeccbaf05/telemeter-client/0.log" Jun 13 04:06:14.091793 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:14.091767 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-97895659f-fdzh7_7d790ce5-6339-4fcf-9e86-97dbeccbaf05/reload/0.log" Jun 13 04:06:14.114145 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:14.114109 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-97895659f-fdzh7_7d790ce5-6339-4fcf-9e86-97dbeccbaf05/kube-rbac-proxy/0.log" Jun 13 04:06:14.162755 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:14.162735 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/thanos-query/0.log" Jun 13 04:06:14.180102 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:14.180082 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/kube-rbac-proxy-web/0.log" Jun 13 04:06:14.201956 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:14.201936 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/kube-rbac-proxy/0.log" Jun 13 04:06:14.222279 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:14.222263 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/prom-label-proxy/0.log" Jun 13 04:06:14.247833 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:14.247816 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/kube-rbac-proxy-rules/0.log" Jun 13 04:06:14.271628 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:14.271597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bf4686fb-9xb7v_4f0101cb-a377-4ff4-b139-6c81774428ba/kube-rbac-proxy-metrics/0.log" Jun 13 04:06:15.649031 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:15.649002 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-8pcb5_0b47462a-ec83-49b8-af0a-e5a3dac8866c/networking-console-plugin/0.log" Jun 13 04:06:16.277811 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.277781 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/1.log" Jun 13 04:06:16.283414 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.283389 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-gbtj5_12d447f6-5d0f-4ba7-8bfa-c98b70deb6d4/console-operator/2.log" Jun 13 04:06:16.832826 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.832800 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-758df4989-clfpz_11507190-723b-4767-9170-19e800680b3a/console/0.log" Jun 13 04:06:16.850724 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.850701 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5"] Jun 13 04:06:16.854137 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.854107 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:16.857177 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.857155 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s47zn\"/\"kube-root-ca.crt\"" Jun 13 04:06:16.857177 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.857155 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s47zn\"/\"openshift-service-ca.crt\"" Jun 13 04:06:16.858416 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.858393 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s47zn\"/\"default-dockercfg-b27ql\"" Jun 13 04:06:16.861214 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.861192 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5"] Jun 13 04:06:16.868229 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.868209 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-tzqjl_73011311-2adb-495a-98fc-8d9bcd152ac1/download-server/0.log" Jun 13 04:06:16.917198 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.917176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-sys\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:16.917306 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.917211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-lib-modules\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:16.917306 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.917274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-podres\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:16.917379 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.917308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-proc\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:16.917379 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:16.917333 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghq9b\" (UniqueName: \"kubernetes.io/projected/689650a0-3ab3-4383-a1a1-9da0fea1153a-kube-api-access-ghq9b\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.018240 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.018215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-podres\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.018342 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.018244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-proc\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.018342 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.018264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghq9b\" (UniqueName: \"kubernetes.io/projected/689650a0-3ab3-4383-a1a1-9da0fea1153a-kube-api-access-ghq9b\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.018342 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.018335 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-proc\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.018462 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.018327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-sys\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.018462 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.018387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-podres\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.018462 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.018387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-sys\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.018462 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.018405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-lib-modules\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.018607 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.018477 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/689650a0-3ab3-4383-a1a1-9da0fea1153a-lib-modules\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.026441 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.026419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghq9b\" (UniqueName: \"kubernetes.io/projected/689650a0-3ab3-4383-a1a1-9da0fea1153a-kube-api-access-ghq9b\") pod \"perf-node-gather-daemonset-f2tv5\" (UID: \"689650a0-3ab3-4383-a1a1-9da0fea1153a\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.166053 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.165989 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:17.296090 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.296064 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5"] Jun 13 04:06:17.297983 ip-10-0-133-206 kubenswrapper[2574]: W0613 04:06:17.297952 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod689650a0_3ab3_4383_a1a1_9da0fea1153a.slice/crio-b02f71c3ee10a370da87a826cf54b1a882d96770c318e77599b0784de16e0c47 WatchSource:0}: Error finding container b02f71c3ee10a370da87a826cf54b1a882d96770c318e77599b0784de16e0c47: Status 404 returned error can't find the container with id b02f71c3ee10a370da87a826cf54b1a882d96770c318e77599b0784de16e0c47 Jun 13 04:06:17.687699 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:17.687622 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-ljvnz_254728fe-5db9-4e9b-963a-5c81ce41f8e0/volume-data-source-validator/0.log" Jun 13 04:06:18.060265 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:18.060174 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" event={"ID":"689650a0-3ab3-4383-a1a1-9da0fea1153a","Type":"ContainerStarted","Data":"019a3cbc6958ef03edef26ac8e4391af8746e175958faf7e533396603dfb4b61"} Jun 13 04:06:18.060265 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:18.060227 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" event={"ID":"689650a0-3ab3-4383-a1a1-9da0fea1153a","Type":"ContainerStarted","Data":"b02f71c3ee10a370da87a826cf54b1a882d96770c318e77599b0784de16e0c47"} Jun 13 04:06:18.060658 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:18.060313 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:18.077781 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:18.077733 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" podStartSLOduration=2.077720512 podStartE2EDuration="2.077720512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 04:06:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 04:06:18.076426352 +0000 UTC m=+1329.707088974" watchObservedRunningTime="2026-06-13 04:06:18.077720512 +0000 UTC m=+1329.708383101" Jun 13 04:06:18.860977 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:18.860949 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xp674_934bab98-9352-4baf-a814-242cadd9cbba/dns/0.log" Jun 13 04:06:18.880509 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:18.880476 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xp674_934bab98-9352-4baf-a814-242cadd9cbba/kube-rbac-proxy/0.log" Jun 13 04:06:18.904345 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:18.904328 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hprjm_05ed7d04-f583-4e9a-8acb-74a8411da301/dns-node-resolver/0.log" Jun 13 04:06:19.482904 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:19.482870 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-db8dc949-5s4k9_323d7022-5268-4c98-b8be-b67c1cfbb854/registry/0.log" Jun 13 04:06:19.486760 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:19.486739 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-db8dc949-5s4k9_323d7022-5268-4c98-b8be-b67c1cfbb854/registry/1.log" Jun 13 04:06:19.503881 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:19.503860 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdtxs_d873938a-d1bf-4847-a272-c8a9ef0cd6ad/node-ca/0.log" Jun 13 04:06:20.528298 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:20.528262 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-pzc7m_39428403-f0b4-447f-aa88-b83cb0d4b449/discovery/0.log" Jun 13 04:06:20.546979 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:20.546937 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-7pj8n_0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb/kube-auth-proxy/0.log" Jun 13 04:06:20.621374 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:20.621347 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8pvtd_b4980bfb-8203-4328-9ddb-4c737d89f31e/payload-pre-processing/0.log" Jun 13 04:06:21.329734 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:21.329706 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kch4f_bb9632cf-9f2f-4fef-a826-c1ae86cf4c5a/serve-healthcheck-canary/0.log" Jun 13 04:06:21.865614 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:21.865590 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bfwx_24a5f9f2-1228-4752-aedf-4369219bb0f6/kube-rbac-proxy/0.log" Jun 13 04:06:21.884622 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:21.884602 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bfwx_24a5f9f2-1228-4752-aedf-4369219bb0f6/exporter/0.log" Jun 13 04:06:21.903738 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:21.903715 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bfwx_24a5f9f2-1228-4752-aedf-4369219bb0f6/extractor/0.log" Jun 13 04:06:24.075653 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:24.075629 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-f2tv5" Jun 13 04:06:24.317067 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:24.316996 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-b765c74d8-wrcst_2997320f-3207-4c0a-bc09-b0b3cd3c2fbe/nginx/0.log" Jun 13 04:06:24.340233 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:24.340158 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-6s6wx_5e65049b-dec5-426c-aa3d-4e6dd2077bee/manager/0.log" Jun 13 04:06:24.374012 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:24.373967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-k4ml6_a1f21225-2ae4-47b9-a40c-ca199cb5c300/manager/0.log" Jun 13 04:06:24.417469 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:24.417442 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688720-s4sbr_e77d92d3-514c-4e48-8877-21261ecec4d9/cleanup/0.log" Jun 13 04:06:24.465366 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:24.465341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-gsk6j_72e963f2-757b-4a44-83a1-2d110e55928d/server/0.log" Jun 13 04:06:24.651028 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:24.650946 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8b9444ff-l58kf_315638a9-60d1-41dc-af7e-c4e97f3f18b4/manager/0.log" Jun 13 04:06:24.667083 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:24.667056 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8b9444ff-l58kf_315638a9-60d1-41dc-af7e-c4e97f3f18b4/copy-manifests/0.log" Jun 13 04:06:26.218008 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:26.217959 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-g8wkv_563728c4-3fda-4887-872d-18237397aba6/openshift-lws-operator/0.log" Jun 13 04:06:30.962803 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:30.962758 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-pzc7m_39428403-f0b4-447f-aa88-b83cb0d4b449/discovery/0.log" Jun 13 04:06:30.971492 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:30.971464 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-7pj8n_0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb/kube-auth-proxy/0.log" Jun 13 04:06:31.015888 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:31.015868 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8pvtd_b4980bfb-8203-4328-9ddb-4c737d89f31e/payload-pre-processing/0.log" Jun 13 04:06:32.258083 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:32.258053 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-pzc7m_39428403-f0b4-447f-aa88-b83cb0d4b449/discovery/0.log" Jun 13 04:06:32.268038 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:32.268000 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-7pj8n_0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb/kube-auth-proxy/0.log" Jun 13 04:06:32.330866 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:32.330835 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8pvtd_b4980bfb-8203-4328-9ddb-4c737d89f31e/payload-pre-processing/0.log" Jun 13 04:06:33.263950 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.263919 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckjmp_ff2c56e2-c0e4-4c1b-8668-cac0a19a7919/kube-multus-additional-cni-plugins/0.log" Jun 13 04:06:33.284494 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.284473 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckjmp_ff2c56e2-c0e4-4c1b-8668-cac0a19a7919/egress-router-binary-copy/0.log" Jun 13 04:06:33.305986 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.305965 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckjmp_ff2c56e2-c0e4-4c1b-8668-cac0a19a7919/cni-plugins/0.log" Jun 13 04:06:33.324448 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.324427 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckjmp_ff2c56e2-c0e4-4c1b-8668-cac0a19a7919/bond-cni-plugin/0.log" Jun 13 04:06:33.343535 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.343517 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckjmp_ff2c56e2-c0e4-4c1b-8668-cac0a19a7919/routeoverride-cni/0.log" Jun 13 04:06:33.363093 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.363074 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckjmp_ff2c56e2-c0e4-4c1b-8668-cac0a19a7919/whereabouts-cni-bincopy/0.log" Jun 13 04:06:33.382372 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.382352 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckjmp_ff2c56e2-c0e4-4c1b-8668-cac0a19a7919/whereabouts-cni/0.log" Jun 13 04:06:33.780479 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.780454 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kxddx_8dffa386-13e6-4d56-beda-749d7c887d84/kube-multus/0.log" Jun 13 04:06:33.877699 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.877675 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tbxdr_5249c400-ac62-4edd-b111-d6529a4e672d/network-metrics-daemon/0.log" Jun 13 04:06:33.897287 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:33.897266 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tbxdr_5249c400-ac62-4edd-b111-d6529a4e672d/kube-rbac-proxy/0.log" Jun 13 04:06:34.016345 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:34.016321 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-pzc7m_39428403-f0b4-447f-aa88-b83cb0d4b449/discovery/0.log" Jun 13 04:06:34.046038 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:34.045977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-7pj8n_0f2f4c8a-fca1-404f-a4a6-a7a46d11aecb/kube-auth-proxy/0.log" Jun 13 04:06:34.102866 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:34.102832 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8pvtd_b4980bfb-8203-4328-9ddb-4c737d89f31e/payload-pre-processing/0.log" Jun 13 04:06:34.905542 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:34.905512 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-548bh_72c23acf-2ed0-49c1-9c38-e875dc76ebda/ovn-controller/0.log" Jun 13 04:06:34.922141 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:34.922102 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-548bh_72c23acf-2ed0-49c1-9c38-e875dc76ebda/ovn-acl-logging/0.log" Jun 13 04:06:34.943709 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:34.943686 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-548bh_72c23acf-2ed0-49c1-9c38-e875dc76ebda/kube-rbac-proxy-node/0.log" Jun 13 04:06:34.962301 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:34.962284 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-548bh_72c23acf-2ed0-49c1-9c38-e875dc76ebda/kube-rbac-proxy-ovn-metrics/0.log" Jun 13 04:06:34.978729 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:34.978701 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-548bh_72c23acf-2ed0-49c1-9c38-e875dc76ebda/northd/0.log" Jun 13 04:06:35.001444 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:35.001423 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-548bh_72c23acf-2ed0-49c1-9c38-e875dc76ebda/nbdb/0.log" Jun 13 04:06:35.023927 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:35.023911 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-548bh_72c23acf-2ed0-49c1-9c38-e875dc76ebda/sbdb/0.log" Jun 13 04:06:35.062564 ip-10-0-133-206 kubenswrapper[2574]: I0613 04:06:35.062542 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-548bh_72c23acf-2ed0-49c1-9c38-e875dc76ebda/ovnkube-controller/0.log"