Jun 13 00:56:10.330050 ip-10-0-129-95 systemd[1]: Starting Kubernetes Kubelet... Jun 13 00:56:10.686102 ip-10-0-129-95 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 00:56:10.686102 ip-10-0-129-95 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 00:56:10.686102 ip-10-0-129-95 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 00:56:10.686102 ip-10-0-129-95 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 00:56:10.686102 ip-10-0-129-95 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 00:56:10.687057 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.686969 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 00:56:10.691217 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691200 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:56:10.691217 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691216 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691220 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691224 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691227 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691230 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691234 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691237 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691240 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691245 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691249 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691252 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691255 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691258 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691261 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691265 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691268 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691272 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691275 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691277 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691280 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:56:10.691286 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691283 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691286 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691288 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691291 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691295 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691297 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691300 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691303 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691305 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691308 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691311 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691314 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691316 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691319 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691321 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691324 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691326 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691329 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691331 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691334 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:56:10.691788 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691337 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691339 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691342 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691344 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691346 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691349 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691352 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691354 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691358 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691362 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691365 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691368 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691370 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691373 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691376 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691379 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691382 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691386 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691389 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:56:10.692277 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691392 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691395 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691398 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691400 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691403 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691406 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691409 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691411 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691414 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691421 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691424 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691427 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691430 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691432 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691435 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691437 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691440 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691442 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691445 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691447 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:56:10.692731 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691449 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691452 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691454 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691457 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691460 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691462 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691465 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691469 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691472 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691475 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691477 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691480 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691482 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691484 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691487 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691490 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691492 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691495 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.691497 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692194 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:56:10.693266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692200 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692203 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692207 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692210 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692212 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692215 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692218 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692220 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692223 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692226 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692228 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692230 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692235 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692239 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692242 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692244 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692247 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692250 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692254 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692257 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:56:10.693772 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692260 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692263 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692266 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692269 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692272 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692274 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692277 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692279 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692284 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692288 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692291 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692294 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692297 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692300 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692319 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692323 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692326 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692329 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692333 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:56:10.694279 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692337 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692340 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692343 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692346 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692348 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692351 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692354 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692356 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692359 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692361 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692364 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692366 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692369 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692372 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692375 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692378 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692380 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692383 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692385 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692388 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:56:10.694766 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692391 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692394 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692396 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692399 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692402 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692404 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692407 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692409 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692412 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692415 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692418 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692420 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692423 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692425 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692428 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692430 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692433 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692435 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692438 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692440 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:56:10.695254 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692443 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692445 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692448 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692451 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692454 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692456 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692459 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692461 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692464 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692466 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692469 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692471 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692474 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692476 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692479 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692481 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692484 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692486 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692489 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692879 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:56:10.695761 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692885 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692888 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692891 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692894 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692897 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692899 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692902 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692905 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692907 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692910 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692913 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692915 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692918 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692921 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692923 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692926 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692928 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692931 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692934 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692936 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:56:10.696251 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692939 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692941 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692944 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692946 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692949 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692951 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692954 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692956 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692959 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692962 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692964 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692967 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692969 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692973 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692976 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692979 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692983 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692987 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692990 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:56:10.696744 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692994 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.692997 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693000 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693003 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693006 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693009 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693011 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693014 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693017 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693020 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693022 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693025 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693027 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693030 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693032 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693035 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693037 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693039 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693042 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:56:10.697272 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693044 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693047 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693049 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693052 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693055 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693058 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693061 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693063 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693066 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693069 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693071 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693074 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693076 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693079 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693083 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693086 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693088 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693091 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693094 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693097 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:56:10.697753 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693100 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693102 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693105 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693107 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693109 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693112 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693114 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693117 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693119 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693121 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693124 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693126 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693129 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693131 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693138 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693140 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693143 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693145 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693148 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693151 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:56:10.698243 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693230 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693245 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693254 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693261 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693265 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693269 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693273 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693278 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693281 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693284 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693288 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693291 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693294 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693297 2563 flags.go:64] FLAG: --cgroup-root="" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693300 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693303 2563 flags.go:64] FLAG: --client-ca-file="" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693306 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693309 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693314 2563 flags.go:64] FLAG: --cluster-domain="" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693317 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693320 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693323 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693326 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693330 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 00:56:10.698720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693333 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693336 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693341 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693344 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693347 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693350 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693355 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693358 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693362 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693365 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693368 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693371 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693374 2563 flags.go:64] FLAG: --enable-server="true" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693377 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693381 2563 flags.go:64] FLAG: --event-burst="100" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693384 2563 flags.go:64] FLAG: --event-qps="50" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693387 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693390 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693393 2563 flags.go:64] FLAG: --eviction-hard="" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693397 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693400 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693403 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693406 2563 flags.go:64] FLAG: --eviction-soft="" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693409 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693411 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 00:56:10.699322 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693415 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693417 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693420 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693423 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693426 2563 flags.go:64] FLAG: --feature-gates="" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693430 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693433 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693436 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693439 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693443 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693446 2563 flags.go:64] FLAG: --help="false" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693449 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-129-95.ec2.internal" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693452 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693457 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693460 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693463 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693467 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693470 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693473 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693476 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693479 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693482 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693485 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693488 2563 flags.go:64] FLAG: --kube-reserved="" Jun 13 00:56:10.700047 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693491 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693494 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693497 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693500 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693503 2563 flags.go:64] FLAG: --lock-file="" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693506 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693509 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693554 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693561 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693564 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693567 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693571 2563 flags.go:64] FLAG: --logging-format="text" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693573 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693577 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693580 2563 flags.go:64] FLAG: --manifest-url="" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693582 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693587 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693591 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693595 2563 flags.go:64] FLAG: --max-pods="110" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693598 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693602 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693606 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693609 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693612 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693615 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 00:56:10.700669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693618 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693625 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693628 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693632 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693635 2563 flags.go:64] FLAG: --pod-cidr="" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693638 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693643 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693646 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693649 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693652 2563 flags.go:64] FLAG: --port="10250" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693655 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693658 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00db8ee9c36cab472" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693661 2563 flags.go:64] FLAG: --qos-reserved="" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693664 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693667 2563 flags.go:64] FLAG: --register-node="true" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693670 2563 flags.go:64] FLAG: --register-with-taints="" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693678 2563 flags.go:64] FLAG: --registry-burst="10" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693681 2563 flags.go:64] FLAG: --registry-qps="5" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693684 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693687 2563 flags.go:64] FLAG: --reserved-memory="" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693690 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693693 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693697 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693699 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693702 2563 flags.go:64] FLAG: --runonce="false" Jun 13 00:56:10.701395 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693706 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693710 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693712 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693716 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693719 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693722 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693725 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693729 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693744 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693747 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693750 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693754 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693757 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693760 2563 flags.go:64] FLAG: --system-cgroups="" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693763 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693769 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693771 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693774 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693779 2563 flags.go:64] FLAG: --tls-min-version="" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693782 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693794 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693797 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693800 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693803 2563 flags.go:64] FLAG: --v="2" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693807 2563 flags.go:64] FLAG: --version="false" Jun 13 00:56:10.702313 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693812 2563 flags.go:64] FLAG: --vmodule="" Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693815 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.693819 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693935 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693939 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693942 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693945 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693949 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693952 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693955 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693959 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693963 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693967 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693970 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693973 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693976 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693979 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693982 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693985 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:56:10.702990 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693988 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693991 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693993 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693996 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.693999 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694001 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694004 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694006 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694009 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694011 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694014 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694016 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694019 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694021 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694024 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694027 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694030 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694032 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694035 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694037 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:56:10.703472 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694041 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694043 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694046 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694050 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694053 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694055 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694059 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694063 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694066 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694068 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694071 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694074 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694077 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694080 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694082 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694085 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694087 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694090 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694092 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:56:10.704063 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694095 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694097 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694100 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694103 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694105 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694108 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694110 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694114 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694117 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694120 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694123 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694126 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694128 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694132 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694135 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694138 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694142 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694144 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694147 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694149 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:56:10.704530 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694152 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694154 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694157 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694159 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694162 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694165 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694167 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694170 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694173 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694176 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694178 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694180 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694183 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694186 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694188 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694191 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694193 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694196 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694198 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694201 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:56:10.705030 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694204 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694206 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694209 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.694211 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.694758 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.702809 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.702828 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.702850 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.702860 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702920 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702925 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702928 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702931 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702934 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702938 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:56:10.705508 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702940 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702943 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702946 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702949 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702951 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702954 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702957 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702959 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702962 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702964 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702967 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702969 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702972 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702974 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702977 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702980 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702982 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702986 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702989 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702992 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:56:10.705920 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702994 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.702997 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703000 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703003 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703006 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703009 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703011 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703014 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703017 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703020 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703022 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703025 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703027 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703030 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703033 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703036 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703038 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703041 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703044 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703046 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:56:10.706405 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703049 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703051 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703054 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703058 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703062 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703065 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703068 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703071 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703074 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703077 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703080 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703083 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703086 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703088 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703091 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703095 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703097 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703100 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703103 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:56:10.706917 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703105 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703108 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703110 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703113 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703115 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703119 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703123 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703127 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703130 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703133 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703136 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703139 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703142 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703145 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703149 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703152 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703155 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703157 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703160 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:56:10.707372 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703162 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703165 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703168 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703170 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703173 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703176 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703179 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703182 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703184 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703188 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703190 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703193 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703196 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703198 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703201 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:56:10.707840 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.703206 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703323 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703328 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703331 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703335 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703340 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703344 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703347 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703350 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703353 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703356 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703359 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703362 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703365 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703368 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703370 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703373 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703376 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703378 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:56:10.708240 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703381 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703383 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703386 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703388 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703391 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703394 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703397 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703400 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703402 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703405 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703408 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703410 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703413 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703416 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703420 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703423 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703426 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703429 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703432 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703434 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:56:10.708684 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703437 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703440 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703443 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703445 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703448 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703450 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703453 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703456 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703459 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703461 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703464 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703466 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703469 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703471 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703474 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703476 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703479 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703482 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703485 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:56:10.709266 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703488 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703490 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703493 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703495 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703498 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703500 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703503 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703505 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703508 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703510 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703513 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703516 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703518 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703521 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703523 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703526 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703528 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703531 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703533 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703536 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:56:10.709745 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703539 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703542 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703544 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703547 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703549 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703551 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703554 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703556 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703559 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703562 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703565 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703568 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703571 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703573 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703575 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703578 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703580 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703583 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703586 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703588 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:56:10.710256 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703591 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:56:10.711089 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:10.703593 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:56:10.711089 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.703598 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 00:56:10.711089 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.703723 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 00:56:10.711089 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.706457 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 00:56:10.711089 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.707589 2563 server.go:1019] "Starting client certificate rotation" Jun 13 00:56:10.711089 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.707687 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 00:56:10.711089 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.707722 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 00:56:10.711089 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.709798 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 00:56:10.711089 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.710997 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 00:56:10.721286 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.721270 2563 log.go:25] "Validated CRI v1 runtime API" Jun 13 00:56:10.724126 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.724112 2563 log.go:25] "Validated CRI v1 image API" Jun 13 00:56:10.724958 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.724944 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 00:56:10.728403 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.728384 2563 fs.go:135] Filesystem UUIDs: map[2c2c8d33-a614-45f7-bb85-0a8e1dbe36cf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8fbd36c3-b382-4c8f-b241-b1b6597da2c0:/dev/nvme0n1p4] Jun 13 00:56:10.728473 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.728403 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 00:56:10.730530 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.730513 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 00:56:10.733596 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.733485 2563 manager.go:216] Machine: {Timestamp:2026-06-13 00:56:10.73226373 +0000 UTC m=+0.293758179 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3123647 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2be7d6b4f963d1757bbac1d0642cbb SystemUUID:ec2be7d6-b4f9-63d1-757b-bac1d0642cbb BootID:a84f400a-dd7f-4b79-8ebf-6159ac863f8b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:00:ae:74:dc:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:00:ae:74:dc:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:5c:a7:91:5b:59 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 00:56:10.733596 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.733595 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 00:56:10.733688 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.733676 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 00:56:10.736317 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.736292 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 00:56:10.736836 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.736320 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 00:56:10.737540 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.737517 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 00:56:10.737622 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.737546 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 00:56:10.737622 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.737557 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 00:56:10.738925 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.738906 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 00:56:10.740332 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.740321 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 00:56:10.743866 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.743855 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 13 00:56:10.743976 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.743967 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 00:56:10.744015 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.743997 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 13 00:56:10.744015 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.744006 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 00:56:10.744081 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.744020 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 00:56:10.744081 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.744030 2563 kubelet.go:398] "Adding apiserver pod source" Jun 13 00:56:10.744081 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.744039 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 00:56:10.744425 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.744412 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 00:56:10.744460 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.744434 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 00:56:10.746279 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.746259 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 00:56:10.747690 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.747674 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 00:56:10.747791 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.747704 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 00:56:10.747874 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.747863 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 00:56:10.747903 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.747882 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 00:56:10.747903 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.747891 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 00:56:10.747962 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.747905 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 00:56:10.747962 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.747914 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 00:56:10.747962 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.747920 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 00:56:10.748445 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.748436 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 00:56:10.748445 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.748445 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 00:56:10.748506 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.748452 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 00:56:10.748506 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.748458 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 00:56:10.748506 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.748468 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 00:56:10.748506 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.748477 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 00:56:10.748506 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.748500 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 00:56:10.748506 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.748505 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 00:56:10.751843 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.751826 2563 server.go:1268] "Started kubelet" Jun 13 00:56:10.752123 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.752098 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 00:56:10.752205 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.752178 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 00:56:10.752252 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.752218 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 00:56:10.754200 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.753932 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 00:56:10.754200 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.754078 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 00:56:10.754200 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.754183 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 00:56:10.754369 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.754225 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 00:56:10.754282 ip-10-0-129-95 systemd[1]: Started Kubernetes Kubelet. Jun 13 00:56:10.754527 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.754409 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 13 00:56:10.757682 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.757658 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 00:56:10.757682 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.757670 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 00:56:10.757833 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.757786 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:10.758188 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.758166 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 00:56:10.758338 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758325 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 00:56:10.758394 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758345 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 00:56:10.758394 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758360 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 00:56:10.758505 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758491 2563 factory.go:55] Registering systemd factory Jun 13 00:56:10.758548 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758511 2563 factory.go:223] Registration of the systemd container factory successfully Jun 13 00:56:10.758622 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758611 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 13 00:56:10.758664 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758623 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 13 00:56:10.758780 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758768 2563 factory.go:153] Registering CRI-O factory Jun 13 00:56:10.758834 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758785 2563 factory.go:223] Registration of the crio container factory successfully Jun 13 00:56:10.758873 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758836 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 00:56:10.758873 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758859 2563 factory.go:103] Registering Raw factory Jun 13 00:56:10.758873 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.758872 2563 manager.go:1196] Started watching for new ooms in manager Jun 13 00:56:10.759387 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.759373 2563 manager.go:349] Starting recovery of all containers Jun 13 00:56:10.761058 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.761039 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rj56x" Jun 13 00:56:10.763975 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.763950 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 13 00:56:10.766406 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.766232 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 13 00:56:10.767052 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.762857 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-95.ec2.internal.18b87dfb43bdb344 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-95.ec2.internal,UID:ip-10-0-129-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-95.ec2.internal,},FirstTimestamp:2026-06-13 00:56:10.751800132 +0000 UTC m=+0.313294629,LastTimestamp:2026-06-13 00:56:10.751800132 +0000 UTC m=+0.313294629,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-95.ec2.internal,}" Jun 13 00:56:10.770701 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.770677 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rj56x" Jun 13 00:56:10.771964 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.771946 2563 manager.go:354] Recovery completed Jun 13 00:56:10.776471 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.776458 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:56:10.778476 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.778462 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:56:10.778523 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.778488 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:56:10.778523 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.778497 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:56:10.779093 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.779073 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 00:56:10.779093 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.779093 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 00:56:10.779202 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.779109 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:56:10.779202 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.779112 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 13 00:56:10.779915 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.779822 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:56:10.779915 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.779853 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:56:10.779915 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.779867 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:56:10.781179 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.781166 2563 policy_none.go:49] "None policy: Start" Jun 13 00:56:10.781222 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.781182 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 00:56:10.781222 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.781192 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 00:56:10.783252 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.783237 2563 policy_none.go:47] "Start" Jun 13 00:56:10.826325 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.826308 2563 manager.go:337] "Starting Device Plugin manager" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.826345 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.826355 2563 server.go:87] "Starting device plugin registration server" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.826592 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.826607 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.826701 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.826794 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.826803 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.827809 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.827852 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.835515 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.836708 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.836770 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.836814 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.836869 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 00:56:10.849882 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.839596 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:56:10.926934 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.926900 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:56:10.927905 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.927887 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:56:10.928015 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.927922 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:56:10.928015 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.927933 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:56:10.928015 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.927956 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-95.ec2.internal" Jun 13 00:56:10.936549 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.936505 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-95.ec2.internal" Jun 13 00:56:10.936549 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.936528 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-95.ec2.internal\": node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:10.937149 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.937130 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal"] Jun 13 00:56:10.937215 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.937201 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:56:10.938618 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.938602 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:56:10.938699 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.938627 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:56:10.938699 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.938640 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:56:10.941033 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.941017 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:56:10.941122 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.941105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" Jun 13 00:56:10.941209 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.941138 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:56:10.941870 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.941853 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:56:10.941975 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.941883 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:56:10.941975 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.941859 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:56:10.941975 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.941894 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:56:10.941975 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.941916 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:56:10.941975 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.941933 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:56:10.944312 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.944297 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" Jun 13 00:56:10.944399 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.944326 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:56:10.945160 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.945147 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:56:10.945252 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.945177 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:56:10.945252 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.945193 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:56:10.951601 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.951584 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:10.959304 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.959284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4051e63320b3c60924bbcdfe08cc833-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"a4051e63320b3c60924bbcdfe08cc833\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" Jun 13 00:56:10.959393 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.959314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4051e63320b3c60924bbcdfe08cc833-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"a4051e63320b3c60924bbcdfe08cc833\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" Jun 13 00:56:10.959393 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.959335 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-95.ec2.internal\" not found" node="ip-10-0-129-95.ec2.internal" Jun 13 00:56:10.959393 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:10.959338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/477309687a47d0ebc33e9d6215f4adc7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-95.ec2.internal\" (UID: \"477309687a47d0ebc33e9d6215f4adc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" Jun 13 00:56:10.962933 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:10.962916 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-95.ec2.internal\" not found" node="ip-10-0-129-95.ec2.internal" Jun 13 00:56:11.052200 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.052165 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:11.059437 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.059417 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4051e63320b3c60924bbcdfe08cc833-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"a4051e63320b3c60924bbcdfe08cc833\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" Jun 13 00:56:11.059512 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.059483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4051e63320b3c60924bbcdfe08cc833-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"a4051e63320b3c60924bbcdfe08cc833\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" Jun 13 00:56:11.059551 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.059509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/477309687a47d0ebc33e9d6215f4adc7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-95.ec2.internal\" (UID: \"477309687a47d0ebc33e9d6215f4adc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" Jun 13 00:56:11.059551 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.059525 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4051e63320b3c60924bbcdfe08cc833-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"a4051e63320b3c60924bbcdfe08cc833\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" Jun 13 00:56:11.059551 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.059534 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/477309687a47d0ebc33e9d6215f4adc7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-95.ec2.internal\" (UID: \"477309687a47d0ebc33e9d6215f4adc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" Jun 13 00:56:11.059656 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.059586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4051e63320b3c60924bbcdfe08cc833-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal\" (UID: \"a4051e63320b3c60924bbcdfe08cc833\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" Jun 13 00:56:11.153135 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.153103 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:11.254003 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.253934 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:11.261297 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.261279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" Jun 13 00:56:11.266517 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.266491 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" Jun 13 00:56:11.354232 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.354191 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:11.454769 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.454724 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:11.555246 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.555212 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:11.655704 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.655672 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:11.707183 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.707153 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 00:56:11.707858 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.707315 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 00:56:11.756302 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.756271 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:11.774092 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:11.774064 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4051e63320b3c60924bbcdfe08cc833.slice/crio-53a62793dd4503df8f962cef9f6161ac3aa8e7ba9ec3e5e0c9ab64707f4d219b WatchSource:0}: Error finding container 53a62793dd4503df8f962cef9f6161ac3aa8e7ba9ec3e5e0c9ab64707f4d219b: Status 404 returned error can't find the container with id 53a62793dd4503df8f962cef9f6161ac3aa8e7ba9ec3e5e0c9ab64707f4d219b Jun 13 00:56:11.774293 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:11.774281 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477309687a47d0ebc33e9d6215f4adc7.slice/crio-38395be04a2d1e71e6444cc52e7b6f1ee505c9a108811e5fda04888effc2f0d2 WatchSource:0}: Error finding container 38395be04a2d1e71e6444cc52e7b6f1ee505c9a108811e5fda04888effc2f0d2: Status 404 returned error can't find the container with id 38395be04a2d1e71e6444cc52e7b6f1ee505c9a108811e5fda04888effc2f0d2 Jun 13 00:56:11.776130 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.776100 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 00:51:10 +0000 UTC" deadline="2028-03-06 14:07:56.687594784 +0000 UTC" Jun 13 00:56:11.776130 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.776127 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15181h11m44.911471114s" Jun 13 00:56:11.779262 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.779248 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 00:56:11.839994 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.839893 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" event={"ID":"477309687a47d0ebc33e9d6215f4adc7","Type":"ContainerStarted","Data":"38395be04a2d1e71e6444cc52e7b6f1ee505c9a108811e5fda04888effc2f0d2"} Jun 13 00:56:11.840961 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.840936 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" event={"ID":"a4051e63320b3c60924bbcdfe08cc833","Type":"ContainerStarted","Data":"53a62793dd4503df8f962cef9f6161ac3aa8e7ba9ec3e5e0c9ab64707f4d219b"} Jun 13 00:56:11.857099 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.857077 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:11.953338 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:11.953308 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:56:11.958155 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:11.958137 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:12.058602 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.058565 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:12.158952 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.158874 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:12.259642 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.259593 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-95.ec2.internal\" not found" Jun 13 00:56:12.267099 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.267065 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:56:12.333916 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.333887 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:56:12.358815 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.358590 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" Jun 13 00:56:12.376107 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.376080 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 00:56:12.376994 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.376972 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" Jun 13 00:56:12.385895 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.385871 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 00:56:12.744847 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.744816 2563 apiserver.go:52] "Watching apiserver" Jun 13 00:56:12.750484 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.750457 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 00:56:12.750917 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.750886 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-zdvtn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal","openshift-multus/multus-additional-cni-plugins-dvn5g","openshift-multus/multus-tpzrx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs","openshift-dns/node-resolver-84mtz","openshift-multus/network-metrics-daemon-mwctw","openshift-network-diagnostics/network-check-target-wmmsp","openshift-network-operator/iptables-alerter-25znr","openshift-ovn-kubernetes/ovnkube-node-l98pw","kube-system/global-pull-secret-syncer-z5vzw","kube-system/konnectivity-agent-scnlj","kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal","openshift-cluster-node-tuning-operator/tuned-vdx75"] Jun 13 00:56:12.753444 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.753423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:12.753549 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.753509 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:12.755660 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.755638 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:12.757702 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.757577 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 00:56:12.757702 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.757588 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ccgc9\"" Jun 13 00:56:12.757702 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.757607 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 00:56:12.758122 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.758083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.758477 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.758458 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 00:56:12.760203 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.760175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.760403 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.760385 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 00:56:12.760664 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.760647 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:56:12.760785 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.760688 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l6sx7\"" Jun 13 00:56:12.760855 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.760842 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 00:56:12.761761 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.761728 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 00:56:12.761996 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.761979 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qxvfs\"" Jun 13 00:56:12.762083 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.762065 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 00:56:12.762150 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.761983 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 00:56:12.762382 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.762359 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.764319 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.764084 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 00:56:12.764319 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.764125 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 00:56:12.764319 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.764144 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5k96s\"" Jun 13 00:56:12.764319 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.764181 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 00:56:12.764578 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.764511 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.766320 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.766237 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pthp6\"" Jun 13 00:56:12.766320 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.766276 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 00:56:12.766474 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.766338 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 00:56:12.766614 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.766599 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 00:56:12.766669 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.766627 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 00:56:12.767281 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.767261 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.769295 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769272 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 00:56:12.769391 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769295 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j8qhz\"" Jun 13 00:56:12.769571 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769553 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 00:56:12.769679 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6663bd3-57e8-481d-b993-93839472ecbf-agent-certs\") pod \"konnectivity-agent-scnlj\" (UID: \"a6663bd3-57e8-481d-b993-93839472ecbf\") " pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:12.769763 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769732 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd23ef17-a48b-4461-b035-2f4c34eb000e-host-slash\") pod \"iptables-alerter-25znr\" (UID: \"dd23ef17-a48b-4461-b035-2f4c34eb000e\") " pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.769832 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55pgw\" (UniqueName: \"kubernetes.io/projected/d9ab10e4-4aee-4ed0-8fe2-918be94d1533-kube-api-access-55pgw\") pod \"node-ca-zdvtn\" (UID: \"d9ab10e4-4aee-4ed0-8fe2-918be94d1533\") " pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.769832 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:12.769928 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6663bd3-57e8-481d-b993-93839472ecbf-konnectivity-ca\") pod \"konnectivity-agent-scnlj\" (UID: \"a6663bd3-57e8-481d-b993-93839472ecbf\") " pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:12.769928 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd23ef17-a48b-4461-b035-2f4c34eb000e-iptables-alerter-script\") pod \"iptables-alerter-25znr\" (UID: \"dd23ef17-a48b-4461-b035-2f4c34eb000e\") " pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.769928 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmbdd\" (UniqueName: \"kubernetes.io/projected/dd23ef17-a48b-4461-b035-2f4c34eb000e-kube-api-access-rmbdd\") pod \"iptables-alerter-25znr\" (UID: \"dd23ef17-a48b-4461-b035-2f4c34eb000e\") " pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.770061 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9ab10e4-4aee-4ed0-8fe2-918be94d1533-host\") pod \"node-ca-zdvtn\" (UID: \"d9ab10e4-4aee-4ed0-8fe2-918be94d1533\") " pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.770061 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.769974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9ab10e4-4aee-4ed0-8fe2-918be94d1533-serviceca\") pod \"node-ca-zdvtn\" (UID: \"d9ab10e4-4aee-4ed0-8fe2-918be94d1533\") " pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.770061 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.770005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pslvn\" (UniqueName: \"kubernetes.io/projected/0b453c90-0c91-4ff6-ad96-12871a0d8224-kube-api-access-pslvn\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:12.770581 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.770488 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 00:56:12.771369 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.771348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:12.771552 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.771524 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:12.774079 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.774055 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.775826 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.775808 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 00:56:12.775973 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.775955 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 00:56:12.776114 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.776100 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b4nnl\"" Jun 13 00:56:12.776561 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.776544 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.778092 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.778076 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b2ggw\"" Jun 13 00:56:12.778202 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.778185 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 00:56:12.778263 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.778219 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 00:56:12.778660 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.778449 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 00:56:12.778660 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.778455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 00:56:12.778660 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.778593 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 00:56:12.778660 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.778609 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 00:56:12.779309 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.779062 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:12.779309 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.779132 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:12.781530 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.781511 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.783448 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.783431 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:56:12.783448 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.783447 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 00:56:12.783606 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.783553 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-646g2\"" Jun 13 00:56:12.793767 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.793731 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wrksl" Jun 13 00:56:12.802953 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.802933 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wrksl" Jun 13 00:56:12.859408 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.859382 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 00:56:12.870970 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.870939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-run-netns\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.871144 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.870977 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-conf-dir\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.871144 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871006 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55pgw\" (UniqueName: \"kubernetes.io/projected/d9ab10e4-4aee-4ed0-8fe2-918be94d1533-kube-api-access-55pgw\") pod \"node-ca-zdvtn\" (UID: \"d9ab10e4-4aee-4ed0-8fe2-918be94d1533\") " pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.871144 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.871144 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-run-systemd\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.871328 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-ovnkube-config\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.871328 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-system-cni-dir\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.871328 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9ab10e4-4aee-4ed0-8fe2-918be94d1533-host\") pod \"node-ca-zdvtn\" (UID: \"d9ab10e4-4aee-4ed0-8fe2-918be94d1533\") " pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.871328 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8b60e61-3e20-4f03-9dfe-995005d3f54e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.871328 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871320 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-cni-bin\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.871508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9ab10e4-4aee-4ed0-8fe2-918be94d1533-host\") pod \"node-ca-zdvtn\" (UID: \"d9ab10e4-4aee-4ed0-8fe2-918be94d1533\") " pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.871508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6663bd3-57e8-481d-b993-93839472ecbf-agent-certs\") pod \"konnectivity-agent-scnlj\" (UID: \"a6663bd3-57e8-481d-b993-93839472ecbf\") " pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:12.871508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-cnibin\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.871508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-os-release\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.871508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-var-lib-openvswitch\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.871508 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-ovn-node-metrics-cert\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.871780 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-cni-dir\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.871780 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-var-lib-cni-multus\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.871780 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd23ef17-a48b-4461-b035-2f4c34eb000e-iptables-alerter-script\") pod \"iptables-alerter-25znr\" (UID: \"dd23ef17-a48b-4461-b035-2f4c34eb000e\") " pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.871780 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9ab10e4-4aee-4ed0-8fe2-918be94d1533-serviceca\") pod \"node-ca-zdvtn\" (UID: \"d9ab10e4-4aee-4ed0-8fe2-918be94d1533\") " pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.871780 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8b60e61-3e20-4f03-9dfe-995005d3f54e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.871780 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-sysconfig\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.871780 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-lib-modules\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.871780 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871765 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-system-cni-dir\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.872176 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871789 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx9mn\" (UniqueName: \"kubernetes.io/projected/78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65-kube-api-access-sx9mn\") pod \"node-resolver-84mtz\" (UID: \"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65\") " pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.872340 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.871839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml5sc\" (UniqueName: \"kubernetes.io/projected/f8b60e61-3e20-4f03-9dfe-995005d3f54e-kube-api-access-ml5sc\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.872402 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872339 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 00:56:12.872452 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-slash\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.872514 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-ovnkube-script-lib\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.872608 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-tuned\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.872724 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-etc-kubernetes\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.872724 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-kubelet\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.872724 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-sysctl-d\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.872724 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872709 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.872946 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-device-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.872946 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bd84a45-1f89-4332-b546-bbefc0576148-kubelet-config\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:12.872946 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.872861 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd23ef17-a48b-4461-b035-2f4c34eb000e-iptables-alerter-script\") pod \"iptables-alerter-25znr\" (UID: \"dd23ef17-a48b-4461-b035-2f4c34eb000e\") " pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.873084 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.873044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-modprobe-d\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.873294 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9ab10e4-4aee-4ed0-8fe2-918be94d1533-serviceca\") pod \"node-ca-zdvtn\" (UID: \"d9ab10e4-4aee-4ed0-8fe2-918be94d1533\") " pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.873301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-var-lib-kubelet\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.873503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/775918d5-1c6e-4393-91b2-6af86d7e1800-cni-binary-copy\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.873569 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbw82\" (UniqueName: \"kubernetes.io/projected/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-kube-api-access-tbw82\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.873622 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-systemd\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.873664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-registration-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.873855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.873907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-var-lib-kubelet\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-hostroot\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65-hosts-file\") pod \"node-resolver-84mtz\" (UID: \"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65\") " pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65-tmp-dir\") pod \"node-resolver-84mtz\" (UID: \"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65\") " pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pslvn\" (UniqueName: \"kubernetes.io/projected/0b453c90-0c91-4ff6-ad96-12871a0d8224-kube-api-access-pslvn\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-systemd-units\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-socket-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-socket-dir-parent\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.876189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-run-k8s-cni-cncf-io\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-cni-netd\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6663bd3-57e8-481d-b993-93839472ecbf-konnectivity-ca\") pod \"konnectivity-agent-scnlj\" (UID: \"a6663bd3-57e8-481d-b993-93839472ecbf\") " pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8b60e61-3e20-4f03-9dfe-995005d3f54e-cni-binary-copy\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd23ef17-a48b-4461-b035-2f4c34eb000e-host-slash\") pod \"iptables-alerter-25znr\" (UID: \"dd23ef17-a48b-4461-b035-2f4c34eb000e\") " pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.874984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bd84a45-1f89-4332-b546-bbefc0576148-dbus\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.875015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-kubernetes\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.875068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-run\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.875661 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6663bd3-57e8-481d-b993-93839472ecbf-konnectivity-ca\") pod \"konnectivity-agent-scnlj\" (UID: \"a6663bd3-57e8-481d-b993-93839472ecbf\") " pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.875751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd23ef17-a48b-4461-b035-2f4c34eb000e-host-slash\") pod \"iptables-alerter-25znr\" (UID: \"dd23ef17-a48b-4461-b035-2f4c34eb000e\") " pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.875793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-tmp\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.875821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-run-multus-certs\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.875917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.875947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-run-openvswitch\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.875994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-sys-fs\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.876031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdfkk\" (UniqueName: \"kubernetes.io/projected/f38af6be-4137-4338-b872-9a28acd86ec5-kube-api-access-wdfkk\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.877042 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.876124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzq5n\" (UniqueName: \"kubernetes.io/projected/775918d5-1c6e-4393-91b2-6af86d7e1800-kube-api-access-fzq5n\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.877903 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.876186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-log-socket\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.877903 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.876215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.877903 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.876261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-env-overrides\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.878504 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-sys\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.878608 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-host\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.878608 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-var-lib-cni-bin\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.878608 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.877162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6663bd3-57e8-481d-b993-93839472ecbf-agent-certs\") pod \"konnectivity-agent-scnlj\" (UID: \"a6663bd3-57e8-481d-b993-93839472ecbf\") " pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:12.878608 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-run-netns\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.878608 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-etc-openvswitch\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.878792 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.876563 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:12.878792 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-sysctl-conf\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.878792 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tmnh\" (UniqueName: \"kubernetes.io/projected/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-kube-api-access-5tmnh\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.878792 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-daemon-config\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.878792 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.878692 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs podName:0b453c90-0c91-4ff6-ad96-12871a0d8224 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:13.378671567 +0000 UTC m=+2.940166031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs") pod "network-metrics-daemon-mwctw" (UID: "0b453c90-0c91-4ff6-ad96-12871a0d8224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:12.878792 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878775 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55pgw\" (UniqueName: \"kubernetes.io/projected/d9ab10e4-4aee-4ed0-8fe2-918be94d1533-kube-api-access-55pgw\") pod \"node-ca-zdvtn\" (UID: \"d9ab10e4-4aee-4ed0-8fe2-918be94d1533\") " pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:12.879108 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878792 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.879108 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:12.879108 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-cnibin\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.879108 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmbdd\" (UniqueName: \"kubernetes.io/projected/dd23ef17-a48b-4461-b035-2f4c34eb000e-kube-api-access-rmbdd\") pod \"iptables-alerter-25znr\" (UID: \"dd23ef17-a48b-4461-b035-2f4c34eb000e\") " pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.879108 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.878908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-run-ovn\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.879108 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.879011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-node-log\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.879108 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.879036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-os-release\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.881376 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.881353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pslvn\" (UniqueName: \"kubernetes.io/projected/0b453c90-0c91-4ff6-ad96-12871a0d8224-kube-api-access-pslvn\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:12.883951 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.883935 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:56:12.885865 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.885824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmbdd\" (UniqueName: \"kubernetes.io/projected/dd23ef17-a48b-4461-b035-2f4c34eb000e-kube-api-access-rmbdd\") pod \"iptables-alerter-25znr\" (UID: \"dd23ef17-a48b-4461-b035-2f4c34eb000e\") " pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:12.980130 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-system-cni-dir\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.980130 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8b60e61-3e20-4f03-9dfe-995005d3f54e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-cni-bin\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-cnibin\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-system-cni-dir\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-os-release\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980225 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-cni-bin\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-var-lib-openvswitch\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980271 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-var-lib-openvswitch\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-ovn-node-metrics-cert\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980289 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-os-release\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980269 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-cnibin\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.980350 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-cni-dir\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-var-lib-cni-multus\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8b60e61-3e20-4f03-9dfe-995005d3f54e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-sysconfig\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-lib-modules\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980436 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-cni-dir\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980461 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-var-lib-cni-multus\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-system-cni-dir\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-system-cni-dir\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9mn\" (UniqueName: \"kubernetes.io/projected/78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65-kube-api-access-sx9mn\") pod \"node-resolver-84mtz\" (UID: \"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65\") " pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml5sc\" (UniqueName: \"kubernetes.io/projected/f8b60e61-3e20-4f03-9dfe-995005d3f54e-kube-api-access-ml5sc\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980529 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-slash\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-ovnkube-script-lib\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-tuned\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980575 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-etc-kubernetes\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-kubelet\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-sysctl-d\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.980889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-device-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bd84a45-1f89-4332-b546-bbefc0576148-kubelet-config\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0bd84a45-1f89-4332-b546-bbefc0576148-kubelet-config\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8b60e61-3e20-4f03-9dfe-995005d3f54e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8b60e61-3e20-4f03-9dfe-995005d3f54e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980890 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-kubelet\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.980947 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-sysconfig\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981048 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-sysctl-d\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981056 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-lib-modules\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-modprobe-d\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-etc-kubernetes\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-var-lib-kubelet\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/775918d5-1c6e-4393-91b2-6af86d7e1800-cni-binary-copy\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-slash\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-var-lib-kubelet\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.981677 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbw82\" (UniqueName: \"kubernetes.io/projected/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-kube-api-access-tbw82\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981205 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-ovnkube-script-lib\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981210 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-device-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981200 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-systemd\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981254 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-registration-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-systemd\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981260 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-modprobe-d\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981298 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-var-lib-kubelet\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-registration-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-hostroot\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65-hosts-file\") pod \"node-resolver-84mtz\" (UID: \"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65\") " pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65-tmp-dir\") pod \"node-resolver-84mtz\" (UID: \"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65\") " pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981419 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-systemd-units\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-var-lib-kubelet\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-socket-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.982564 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981530 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65-hosts-file\") pod \"node-resolver-84mtz\" (UID: \"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65\") " pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-socket-dir-parent\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-run-k8s-cni-cncf-io\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981572 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-hostroot\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981587 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-cni-netd\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8b60e61-3e20-4f03-9dfe-995005d3f54e-cni-binary-copy\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981678 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-socket-dir-parent\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bd84a45-1f89-4332-b546-bbefc0576148-dbus\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981703 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/775918d5-1c6e-4393-91b2-6af86d7e1800-cni-binary-copy\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-kubernetes\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65-tmp-dir\") pod \"node-resolver-84mtz\" (UID: \"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65\") " pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-cni-netd\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-run\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-run\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981832 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-run-k8s-cni-cncf-io\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-socket-dir\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-tmp\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.983381 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981611 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-systemd-units\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-run-multus-certs\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-kubernetes\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981912 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-run-multus-certs\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981928 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-run-openvswitch\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0bd84a45-1f89-4332-b546-bbefc0576148-dbus\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-sys-fs\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.981989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdfkk\" (UniqueName: \"kubernetes.io/projected/f38af6be-4137-4338-b872-9a28acd86ec5-kube-api-access-wdfkk\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f38af6be-4137-4338-b872-9a28acd86ec5-sys-fs\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzq5n\" (UniqueName: \"kubernetes.io/projected/775918d5-1c6e-4393-91b2-6af86d7e1800-kube-api-access-fzq5n\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982021 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-run-openvswitch\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-log-socket\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-env-overrides\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982123 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-sys\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-host\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-var-lib-cni-bin\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-run-netns\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-etc-openvswitch\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-sysctl-conf\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982306 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tmnh\" (UniqueName: \"kubernetes.io/projected/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-kube-api-access-5tmnh\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982314 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-sys\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-daemon-config\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-log-socket\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-run-ovn-kubernetes\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-cnibin\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-run-ovn\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982467 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-cnibin\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-node-log\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-os-release\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-host\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-run-netns\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-conf-dir\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.984566 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982571 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-run-netns\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-run-systemd\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-ovnkube-config\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8b60e61-3e20-4f03-9dfe-995005d3f54e-cni-binary-copy\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-var-lib-cni-bin\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-sysctl-conf\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982774 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-conf-dir\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982805 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-host-run-netns\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982835 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8b60e61-3e20-4f03-9dfe-995005d3f54e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-etc-openvswitch\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-run-systemd\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.982958 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.983037 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.983170 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-ovnkube-config\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.983196 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret podName:0bd84a45-1f89-4332-b546-bbefc0576148 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:13.483178303 +0000 UTC m=+3.044672751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret") pod "global-pull-secret-syncer-z5vzw" (UID: "0bd84a45-1f89-4332-b546-bbefc0576148") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.983363 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-node-log\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985161 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.983394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-env-overrides\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985647 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.983421 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-run-ovn\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985647 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.983422 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/775918d5-1c6e-4393-91b2-6af86d7e1800-os-release\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.985647 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.983481 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/775918d5-1c6e-4393-91b2-6af86d7e1800-multus-daemon-config\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:12.985647 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.983490 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-etc-tuned\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.985647 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.983811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-ovn-node-metrics-cert\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.985647 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.984029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-tmp\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.988360 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.988340 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:56:12.988360 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.988359 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:56:12.988508 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.988371 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7llbl for pod openshift-network-diagnostics/network-check-target-wmmsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:12.988508 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:12.988423 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl podName:19a1fb30-9a8b-4570-9bd4-791902241de9 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:13.488408439 +0000 UTC m=+3.049902877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7llbl" (UniqueName: "kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl") pod "network-check-target-wmmsp" (UID: "19a1fb30-9a8b-4570-9bd4-791902241de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:12.991011 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.990639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx9mn\" (UniqueName: \"kubernetes.io/projected/78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65-kube-api-access-sx9mn\") pod \"node-resolver-84mtz\" (UID: \"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65\") " pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:12.991119 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.991055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tmnh\" (UniqueName: \"kubernetes.io/projected/89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c-kube-api-access-5tmnh\") pod \"tuned-vdx75\" (UID: \"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c\") " pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:12.991119 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.991057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbw82\" (UniqueName: \"kubernetes.io/projected/6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c-kube-api-access-tbw82\") pod \"ovnkube-node-l98pw\" (UID: \"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c\") " pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:12.992552 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.992525 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdfkk\" (UniqueName: \"kubernetes.io/projected/f38af6be-4137-4338-b872-9a28acd86ec5-kube-api-access-wdfkk\") pod \"aws-ebs-csi-driver-node-b2hjs\" (UID: \"f38af6be-4137-4338-b872-9a28acd86ec5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:12.992552 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.992530 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml5sc\" (UniqueName: \"kubernetes.io/projected/f8b60e61-3e20-4f03-9dfe-995005d3f54e-kube-api-access-ml5sc\") pod \"multus-additional-cni-plugins-dvn5g\" (UID: \"f8b60e61-3e20-4f03-9dfe-995005d3f54e\") " pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:12.992683 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:12.992609 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzq5n\" (UniqueName: \"kubernetes.io/projected/775918d5-1c6e-4393-91b2-6af86d7e1800-kube-api-access-fzq5n\") pod \"multus-tpzrx\" (UID: \"775918d5-1c6e-4393-91b2-6af86d7e1800\") " pod="openshift-multus/multus-tpzrx" Jun 13 00:56:13.068571 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.068535 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:13.077695 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.077669 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zdvtn" Jun 13 00:56:13.085545 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.085521 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-25znr" Jun 13 00:56:13.091114 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.091098 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" Jun 13 00:56:13.097781 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.097753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tpzrx" Jun 13 00:56:13.104320 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.104300 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-84mtz" Jun 13 00:56:13.110837 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.110814 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" Jun 13 00:56:13.118525 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.118507 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:13.123051 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.123035 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vdx75" Jun 13 00:56:13.386216 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.386134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:13.386361 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:13.386296 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:13.386361 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:13.386355 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs podName:0b453c90-0c91-4ff6-ad96-12871a0d8224 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:14.386340872 +0000 UTC m=+3.947835307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs") pod "network-metrics-daemon-mwctw" (UID: "0b453c90-0c91-4ff6-ad96-12871a0d8224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:13.487311 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.487280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:13.487487 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:13.487447 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:13.487530 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:13.487516 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret podName:0bd84a45-1f89-4332-b546-bbefc0576148 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:14.48749677 +0000 UTC m=+4.048991223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret") pod "global-pull-secret-syncer-z5vzw" (UID: "0bd84a45-1f89-4332-b546-bbefc0576148") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:13.587889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.587853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:13.588042 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:13.588022 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:56:13.588042 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:13.588040 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:56:13.588116 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:13.588049 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7llbl for pod openshift-network-diagnostics/network-check-target-wmmsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:13.588116 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:13.588096 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl podName:19a1fb30-9a8b-4570-9bd4-791902241de9 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:14.588081649 +0000 UTC m=+4.149576085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7llbl" (UniqueName: "kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl") pod "network-check-target-wmmsp" (UID: "19a1fb30-9a8b-4570-9bd4-791902241de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:13.656680 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:13.656641 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd23ef17_a48b_4461_b035_2f4c34eb000e.slice/crio-38858fd05cd676c5f039ffeac7072ab25fe26f54974da12468a4810d1ad056f9 WatchSource:0}: Error finding container 38858fd05cd676c5f039ffeac7072ab25fe26f54974da12468a4810d1ad056f9: Status 404 returned error can't find the container with id 38858fd05cd676c5f039ffeac7072ab25fe26f54974da12468a4810d1ad056f9 Jun 13 00:56:13.657893 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:13.657871 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b08dc7d_4f48_4252_a8c7_bdb4058d9a5c.slice/crio-5a8f14fe65f8f23b5eb33adb4e177c52c0711b1ae2b2a942f71b5f5793078823 WatchSource:0}: Error finding container 5a8f14fe65f8f23b5eb33adb4e177c52c0711b1ae2b2a942f71b5f5793078823: Status 404 returned error can't find the container with id 5a8f14fe65f8f23b5eb33adb4e177c52c0711b1ae2b2a942f71b5f5793078823 Jun 13 00:56:13.658907 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:13.658882 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775918d5_1c6e_4393_91b2_6af86d7e1800.slice/crio-ba7ed41b4eae5db2c2231da52a4e8b5007b50f1dab6cc422a2e931059dd673a2 WatchSource:0}: Error finding container ba7ed41b4eae5db2c2231da52a4e8b5007b50f1dab6cc422a2e931059dd673a2: Status 404 returned error can't find the container with id ba7ed41b4eae5db2c2231da52a4e8b5007b50f1dab6cc422a2e931059dd673a2 Jun 13 00:56:13.659826 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:13.659794 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b60e61_3e20_4f03_9dfe_995005d3f54e.slice/crio-51469fd9892f679397313dffa185366f776bb4cef801656ed5e8442b662ad62c WatchSource:0}: Error finding container 51469fd9892f679397313dffa185366f776bb4cef801656ed5e8442b662ad62c: Status 404 returned error can't find the container with id 51469fd9892f679397313dffa185366f776bb4cef801656ed5e8442b662ad62c Jun 13 00:56:13.662054 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:13.661927 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d9b6a1_6e5e_4aea_8ca7_58f79c2faf65.slice/crio-d22acfeb3a1655bee8a8e1a7700aba56d695211f4f6da648cf81220ce9d560e1 WatchSource:0}: Error finding container d22acfeb3a1655bee8a8e1a7700aba56d695211f4f6da648cf81220ce9d560e1: Status 404 returned error can't find the container with id d22acfeb3a1655bee8a8e1a7700aba56d695211f4f6da648cf81220ce9d560e1 Jun 13 00:56:13.662721 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:13.662685 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38af6be_4137_4338_b872_9a28acd86ec5.slice/crio-5a4e3c941a62ccf7bc50672e2aea31ae1ebbda4e5f44de37504435574ad19033 WatchSource:0}: Error finding container 5a4e3c941a62ccf7bc50672e2aea31ae1ebbda4e5f44de37504435574ad19033: Status 404 returned error can't find the container with id 5a4e3c941a62ccf7bc50672e2aea31ae1ebbda4e5f44de37504435574ad19033 Jun 13 00:56:13.663498 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:13.663481 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ab10e4_4aee_4ed0_8fe2_918be94d1533.slice/crio-a0790347fc27d6562cc089feaae192dd6304e8fbacfcaab312ffd0a6e002ae89 WatchSource:0}: Error finding container a0790347fc27d6562cc089feaae192dd6304e8fbacfcaab312ffd0a6e002ae89: Status 404 returned error can't find the container with id a0790347fc27d6562cc089feaae192dd6304e8fbacfcaab312ffd0a6e002ae89 Jun 13 00:56:13.806285 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.806058 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 00:51:12 +0000 UTC" deadline="2028-02-05 17:50:58.527457533 +0000 UTC" Jun 13 00:56:13.806285 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.806286 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14464h54m44.721181106s" Jun 13 00:56:13.844987 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.844952 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" event={"ID":"f38af6be-4137-4338-b872-9a28acd86ec5","Type":"ContainerStarted","Data":"5a4e3c941a62ccf7bc50672e2aea31ae1ebbda4e5f44de37504435574ad19033"} Jun 13 00:56:13.846021 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.845993 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zdvtn" event={"ID":"d9ab10e4-4aee-4ed0-8fe2-918be94d1533","Type":"ContainerStarted","Data":"a0790347fc27d6562cc089feaae192dd6304e8fbacfcaab312ffd0a6e002ae89"} Jun 13 00:56:13.847427 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.847404 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" event={"ID":"f8b60e61-3e20-4f03-9dfe-995005d3f54e","Type":"ContainerStarted","Data":"51469fd9892f679397313dffa185366f776bb4cef801656ed5e8442b662ad62c"} Jun 13 00:56:13.849538 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.849515 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tpzrx" event={"ID":"775918d5-1c6e-4393-91b2-6af86d7e1800","Type":"ContainerStarted","Data":"ba7ed41b4eae5db2c2231da52a4e8b5007b50f1dab6cc422a2e931059dd673a2"} Jun 13 00:56:13.850631 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.850603 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerStarted","Data":"5a8f14fe65f8f23b5eb33adb4e177c52c0711b1ae2b2a942f71b5f5793078823"} Jun 13 00:56:13.852465 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.852443 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-25znr" event={"ID":"dd23ef17-a48b-4461-b035-2f4c34eb000e","Type":"ContainerStarted","Data":"38858fd05cd676c5f039ffeac7072ab25fe26f54974da12468a4810d1ad056f9"} Jun 13 00:56:13.854327 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.854305 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" event={"ID":"477309687a47d0ebc33e9d6215f4adc7","Type":"ContainerStarted","Data":"81fd858862824222677c279d9ecab33ae119ae375de11a4582d2dcd3ca65f0aa"} Jun 13 00:56:13.855386 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.855364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-scnlj" event={"ID":"a6663bd3-57e8-481d-b993-93839472ecbf","Type":"ContainerStarted","Data":"19af4fb36ec613ccb27f8ac5c67d24df1e84f4bbdc2589404e8a5bccb2c7e964"} Jun 13 00:56:13.856427 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.856402 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vdx75" event={"ID":"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c","Type":"ContainerStarted","Data":"5dfecba09da9c743fc9c3ba0fb2462d2879c3f282b8a2823576562fad84fd813"} Jun 13 00:56:13.857404 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.857382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-84mtz" event={"ID":"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65","Type":"ContainerStarted","Data":"d22acfeb3a1655bee8a8e1a7700aba56d695211f4f6da648cf81220ce9d560e1"} Jun 13 00:56:13.871532 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:13.871489 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-95.ec2.internal" podStartSLOduration=1.871478566 podStartE2EDuration="1.871478566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:13.871377853 +0000 UTC m=+3.432872303" watchObservedRunningTime="2026-06-13 00:56:13.871478566 +0000 UTC m=+3.432973023" Jun 13 00:56:14.393001 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.392962 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:14.393199 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.393147 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:14.393270 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.393221 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs podName:0b453c90-0c91-4ff6-ad96-12871a0d8224 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:16.393195326 +0000 UTC m=+5.954689767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs") pod "network-metrics-daemon-mwctw" (UID: "0b453c90-0c91-4ff6-ad96-12871a0d8224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:14.493590 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.493549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:14.493808 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.493780 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:14.493886 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.493843 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret podName:0bd84a45-1f89-4332-b546-bbefc0576148 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:16.493825634 +0000 UTC m=+6.055320074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret") pod "global-pull-secret-syncer-z5vzw" (UID: "0bd84a45-1f89-4332-b546-bbefc0576148") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:14.594027 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.593985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:14.594216 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.594196 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:56:14.594273 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.594224 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:56:14.594273 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.594237 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7llbl for pod openshift-network-diagnostics/network-check-target-wmmsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:14.594387 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.594297 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl podName:19a1fb30-9a8b-4570-9bd4-791902241de9 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:16.59427641 +0000 UTC m=+6.155770848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7llbl" (UniqueName: "kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl") pod "network-check-target-wmmsp" (UID: "19a1fb30-9a8b-4570-9bd4-791902241de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:14.806631 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.806558 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 00:51:12 +0000 UTC" deadline="2027-12-11 09:20:42.625989529 +0000 UTC" Jun 13 00:56:14.806631 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.806599 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13112h24m27.819395655s" Jun 13 00:56:14.837900 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.837860 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:14.838058 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.837997 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:14.838430 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.838371 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:14.838521 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.838475 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:14.838572 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.838555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:14.838642 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:14.838622 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:14.878692 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.878091 2563 generic.go:356] "Generic (PLEG): container finished" podID="a4051e63320b3c60924bbcdfe08cc833" containerID="e73ada7a58990f168aa2cec7ce09eabdf23a112a8e71af93650d1cdc71a27ed7" exitCode=0 Jun 13 00:56:14.878692 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:14.878629 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" event={"ID":"a4051e63320b3c60924bbcdfe08cc833","Type":"ContainerDied","Data":"e73ada7a58990f168aa2cec7ce09eabdf23a112a8e71af93650d1cdc71a27ed7"} Jun 13 00:56:15.919903 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:15.919188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" event={"ID":"a4051e63320b3c60924bbcdfe08cc833","Type":"ContainerStarted","Data":"6f9554c451cb51cd9305d368f171adef64f3062b03e385c7243eb4a70d58163d"} Jun 13 00:56:16.410055 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:16.410011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:16.410230 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.410207 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:16.410286 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.410278 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs podName:0b453c90-0c91-4ff6-ad96-12871a0d8224 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:20.410257125 +0000 UTC m=+9.971751562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs") pod "network-metrics-daemon-mwctw" (UID: "0b453c90-0c91-4ff6-ad96-12871a0d8224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:16.510560 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:16.510519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:16.510760 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.510704 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:16.510844 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.510794 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret podName:0bd84a45-1f89-4332-b546-bbefc0576148 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:20.510773278 +0000 UTC m=+10.072267728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret") pod "global-pull-secret-syncer-z5vzw" (UID: "0bd84a45-1f89-4332-b546-bbefc0576148") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:16.611174 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:16.611134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:16.611393 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.611374 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:56:16.611492 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.611403 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:56:16.611492 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.611416 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7llbl for pod openshift-network-diagnostics/network-check-target-wmmsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:16.611492 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.611474 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl podName:19a1fb30-9a8b-4570-9bd4-791902241de9 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:20.611456316 +0000 UTC m=+10.172950775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7llbl" (UniqueName: "kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl") pod "network-check-target-wmmsp" (UID: "19a1fb30-9a8b-4570-9bd4-791902241de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:16.839284 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:16.839254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:16.839460 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.839383 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:16.839811 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:16.839791 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:16.839930 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.839905 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:16.839998 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:16.839967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:16.840216 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:16.840045 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:18.837535 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:18.837415 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:18.837535 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:18.837416 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:18.838048 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:18.837536 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:18.838048 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:18.837647 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:18.838048 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:18.837420 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:18.838048 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:18.837769 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:20.441761 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:20.441598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:20.442203 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.441806 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:20.442203 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.441887 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs podName:0b453c90-0c91-4ff6-ad96-12871a0d8224 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:28.441865926 +0000 UTC m=+18.003360375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs") pod "network-metrics-daemon-mwctw" (UID: "0b453c90-0c91-4ff6-ad96-12871a0d8224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:20.543037 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:20.543000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:20.543242 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.543163 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:20.543242 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.543234 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret podName:0bd84a45-1f89-4332-b546-bbefc0576148 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:28.543215439 +0000 UTC m=+18.104709879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret") pod "global-pull-secret-syncer-z5vzw" (UID: "0bd84a45-1f89-4332-b546-bbefc0576148") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:20.644155 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:20.644006 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:20.644327 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.644165 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:56:20.644327 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.644183 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:56:20.644327 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.644194 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7llbl for pod openshift-network-diagnostics/network-check-target-wmmsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:20.644327 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.644251 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl podName:19a1fb30-9a8b-4570-9bd4-791902241de9 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:28.644234295 +0000 UTC m=+18.205728734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7llbl" (UniqueName: "kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl") pod "network-check-target-wmmsp" (UID: "19a1fb30-9a8b-4570-9bd4-791902241de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:20.838855 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:20.838502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:20.838855 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:20.838580 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:20.838855 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:20.838619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:20.838855 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.838633 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:20.838855 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.838687 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:20.838855 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:20.838783 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:22.839176 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:22.838902 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:22.839176 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:22.838925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:22.839176 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:22.839035 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:22.839176 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:22.839140 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:22.840121 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:22.839959 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:22.840121 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:22.840067 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:24.837165 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:24.837127 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:24.837632 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:24.837128 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:24.837632 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:24.837263 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:24.837632 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:24.837255 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:24.837632 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:24.837385 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:24.837632 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:24.837519 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:26.837180 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:26.837146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:26.837180 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:26.837179 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:26.837657 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:26.837147 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:26.837657 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:26.837256 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:26.837657 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:26.837348 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:26.837657 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:26.837412 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:28.505543 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:28.505450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:28.506015 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.505617 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:28.506015 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.505694 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs podName:0b453c90-0c91-4ff6-ad96-12871a0d8224 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:44.505674166 +0000 UTC m=+34.067168602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs") pod "network-metrics-daemon-mwctw" (UID: "0b453c90-0c91-4ff6-ad96-12871a0d8224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:28.606749 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:28.606701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:28.606899 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.606854 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:28.606950 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.606917 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret podName:0bd84a45-1f89-4332-b546-bbefc0576148 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:44.60690201 +0000 UTC m=+34.168396445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret") pod "global-pull-secret-syncer-z5vzw" (UID: "0bd84a45-1f89-4332-b546-bbefc0576148") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:28.708085 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:28.708039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:28.708258 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.708234 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:56:28.708312 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.708266 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:56:28.708312 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.708282 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7llbl for pod openshift-network-diagnostics/network-check-target-wmmsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:28.708417 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.708343 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl podName:19a1fb30-9a8b-4570-9bd4-791902241de9 nodeName:}" failed. No retries permitted until 2026-06-13 00:56:44.708324671 +0000 UTC m=+34.269819113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7llbl" (UniqueName: "kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl") pod "network-check-target-wmmsp" (UID: "19a1fb30-9a8b-4570-9bd4-791902241de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:28.837279 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:28.837246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:28.837450 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:28.837246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:28.837450 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:28.837246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:28.837450 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.837393 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:28.837596 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.837486 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:28.837596 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:28.837569 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:30.838904 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:30.838874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:30.839328 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:30.838973 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:30.839328 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:30.839019 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:30.839328 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:30.839047 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:30.839328 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:30.839072 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:30.839328 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:30.839158 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:32.837371 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.837182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:32.838258 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.837231 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:32.838258 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:32.837456 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:32.838258 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.837182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:32.838258 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:32.837591 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:32.838258 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:32.837529 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:32.955599 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.955398 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vdx75" event={"ID":"89639fb7-a1fe-4b80-ae49-7f60eb7c3c0c","Type":"ContainerStarted","Data":"2485ddd5e223476257760aebd51dc5940cd5d6b1f19196c8f3fd23cb732e4227"} Jun 13 00:56:32.959970 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.959942 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-84mtz" event={"ID":"78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65","Type":"ContainerStarted","Data":"ab7794ac3af1db8b59617ef247e36639f75ec54f80b467bf84058d8a60dec091"} Jun 13 00:56:32.961796 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.961773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" event={"ID":"f38af6be-4137-4338-b872-9a28acd86ec5","Type":"ContainerStarted","Data":"a99789efb5935f4d41f10811a9bd900bed3d2c3f5d5ee16779ccf994892d7d87"} Jun 13 00:56:32.963489 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.963454 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zdvtn" event={"ID":"d9ab10e4-4aee-4ed0-8fe2-918be94d1533","Type":"ContainerStarted","Data":"b025067eb272a52f46ecf056a292e845220fe08f24209210ed0815619ee15662"} Jun 13 00:56:32.965088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.965068 2563 generic.go:356] "Generic (PLEG): container finished" podID="f8b60e61-3e20-4f03-9dfe-995005d3f54e" containerID="e6c5e2c47934a7fea01a586ec99f182da19eb9ed9579b3ee99105fcb9291b316" exitCode=0 Jun 13 00:56:32.965287 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.965264 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" event={"ID":"f8b60e61-3e20-4f03-9dfe-995005d3f54e","Type":"ContainerDied","Data":"e6c5e2c47934a7fea01a586ec99f182da19eb9ed9579b3ee99105fcb9291b316"} Jun 13 00:56:32.966903 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.966886 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tpzrx" event={"ID":"775918d5-1c6e-4393-91b2-6af86d7e1800","Type":"ContainerStarted","Data":"6e319c013e2a40aa4884dfc2b0a15239e9423ce404c33df4b2a7f5f3fb1c271c"} Jun 13 00:56:32.970189 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.970163 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 00:56:32.971016 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.970536 2563 generic.go:356] "Generic (PLEG): container finished" podID="6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c" containerID="4bd6e5ffeb4a7597ff9bf13d7e7f377d5f68127faf0de64789a9b973464b4985" exitCode=1 Jun 13 00:56:32.971016 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.970617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerStarted","Data":"7cf515ca3bc584261232f2b01733d140daa067e72bed7ce27e615b79f329c2d3"} Jun 13 00:56:32.971016 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.970682 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerStarted","Data":"17fc84bb002d2cb5e855ec8c3896e9971657aa60303e8124099141c94b685ec3"} Jun 13 00:56:32.971016 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.970730 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerStarted","Data":"543c13ceeb60d6a37db57290e9e4ea198ee70d7a5cc4444bbdb69b2d45b647f6"} Jun 13 00:56:32.971016 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.970798 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerDied","Data":"4bd6e5ffeb4a7597ff9bf13d7e7f377d5f68127faf0de64789a9b973464b4985"} Jun 13 00:56:32.971016 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.970850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerStarted","Data":"bc8a2cb6569b53f83d6cec1ad8ecd2ee8e29d9c3bc81e4d77c05ee10868b3076"} Jun 13 00:56:32.972808 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.972784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-scnlj" event={"ID":"a6663bd3-57e8-481d-b993-93839472ecbf","Type":"ContainerStarted","Data":"1e01f0b85e5e54505dc387057ef237bc7ecb849d8c3a85346eb4ba1763712cac"} Jun 13 00:56:32.974149 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.974103 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vdx75" podStartSLOduration=3.345523699 podStartE2EDuration="21.974088705s" totalImagesPullingTime="18.628565006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:32.973880341 +0000 UTC m=+22.535374802" watchObservedRunningTime="2026-06-13 00:56:32.974088705 +0000 UTC m=+22.535583166" Jun 13 00:56:32.974312 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.974285 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-95.ec2.internal" podStartSLOduration=20.974275743 podStartE2EDuration="20.974275743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:15.936913158 +0000 UTC m=+5.498407619" watchObservedRunningTime="2026-06-13 00:56:32.974275743 +0000 UTC m=+22.535770203" Jun 13 00:56:32.989310 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:32.989251 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-84mtz" podStartSLOduration=3.357764356 podStartE2EDuration="21.989234173s" totalImagesPullingTime="18.631469817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:32.989032673 +0000 UTC m=+22.550527132" watchObservedRunningTime="2026-06-13 00:56:32.989234173 +0000 UTC m=+22.550728637" Jun 13 00:56:33.004731 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.004684 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-scnlj" podStartSLOduration=8.554305726 podStartE2EDuration="23.004666493s" totalImagesPullingTime="14.450360767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:33.00447489 +0000 UTC m=+22.565969352" watchObservedRunningTime="2026-06-13 00:56:33.004666493 +0000 UTC m=+22.566160964" Jun 13 00:56:33.059731 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.059604 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zdvtn" podStartSLOduration=4.448174467 podStartE2EDuration="23.059583803s" totalImagesPullingTime="18.611409336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:33.039141343 +0000 UTC m=+22.600635802" watchObservedRunningTime="2026-06-13 00:56:33.059583803 +0000 UTC m=+22.621078261" Jun 13 00:56:33.059885 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.059798 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tpzrx" podStartSLOduration=3.367798616 podStartE2EDuration="22.059791435s" totalImagesPullingTime="18.691992819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:33.058463479 +0000 UTC m=+22.619957939" watchObservedRunningTime="2026-06-13 00:56:33.059791435 +0000 UTC m=+22.621285893" Jun 13 00:56:33.640881 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.640836 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 00:56:33.838341 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.838236 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T00:56:33.64085762Z","UUID":"62a1c953-df74-41cb-bd4f-f30830bffd5f","Handler":null,"Name":"","Endpoint":""} Jun 13 00:56:33.839971 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.839948 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 00:56:33.840085 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.839985 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 00:56:33.976962 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.976927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" event={"ID":"f38af6be-4137-4338-b872-9a28acd86ec5","Type":"ContainerStarted","Data":"e73af54876d7b14f2a88a419172b117f66ae838f714c396a123057f0e23f7fea"} Jun 13 00:56:33.980378 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.980357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 00:56:33.980846 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.980824 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerStarted","Data":"df4a0f468af561e2a2ac418b208effd1be0e33c855a3e0a87a68a8ae111d0d25"} Jun 13 00:56:33.982298 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.982277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-25znr" event={"ID":"dd23ef17-a48b-4461-b035-2f4c34eb000e","Type":"ContainerStarted","Data":"166df077370337229174e65f045663ca81f469143550f481e0c2460f117b723f"} Jun 13 00:56:33.997383 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:33.997342 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-25znr" podStartSLOduration=5.375882487 podStartE2EDuration="23.997324107s" totalImagesPullingTime="18.62144162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:33.997293594 +0000 UTC m=+23.558788044" watchObservedRunningTime="2026-06-13 00:56:33.997324107 +0000 UTC m=+23.558818565" Jun 13 00:56:34.492921 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:34.492883 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:34.493463 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:34.493439 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:34.838055 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:34.838032 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:34.838055 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:34.838044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:34.838226 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:34.838050 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:34.838226 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:34.838154 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:34.838389 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:34.838261 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:34.838389 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:34.838339 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:34.987601 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:34.987563 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" event={"ID":"f38af6be-4137-4338-b872-9a28acd86ec5","Type":"ContainerStarted","Data":"cb04f2af750cd710d51d1f4a2e205ff86c890e39daafd227246eca1e41968054"} Jun 13 00:56:34.987823 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:34.987802 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:34.988383 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:34.988364 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-scnlj" Jun 13 00:56:35.006470 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:35.006364 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hjs" podStartSLOduration=4.316213678 podStartE2EDuration="25.006345249s" totalImagesPullingTime="20.690131571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:35.006163061 +0000 UTC m=+24.567657521" watchObservedRunningTime="2026-06-13 00:56:35.006345249 +0000 UTC m=+24.567839709" Jun 13 00:56:35.994010 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:35.993819 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 00:56:35.994475 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:35.994405 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerStarted","Data":"e480b18608b05f19d8f94d5d39063209fab42687487a6c7d2e96f4656102f9a0"} Jun 13 00:56:36.840421 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:36.840391 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:36.840620 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:36.840507 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:36.840620 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:36.840503 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:36.840620 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:36.840546 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:36.840813 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:36.840624 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:36.840813 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:36.840715 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:38.000913 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.000704 2563 generic.go:356] "Generic (PLEG): container finished" podID="f8b60e61-3e20-4f03-9dfe-995005d3f54e" containerID="5784bb36d849a0e15fd47e326546f2aee698621801864a545c6dbced511f6594" exitCode=0 Jun 13 00:56:38.001690 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.000773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" event={"ID":"f8b60e61-3e20-4f03-9dfe-995005d3f54e","Type":"ContainerDied","Data":"5784bb36d849a0e15fd47e326546f2aee698621801864a545c6dbced511f6594"} Jun 13 00:56:38.004432 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.004415 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 00:56:38.004802 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.004785 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerStarted","Data":"d06983f2aa9094b626bc693e676d201cbfd27ea12ab538542bf156ae9caf15a8"} Jun 13 00:56:38.004984 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.004960 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:38.005077 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.005021 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:38.005213 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.005200 2563 scope.go:117] "RemoveContainer" containerID="4bd6e5ffeb4a7597ff9bf13d7e7f377d5f68127faf0de64789a9b973464b4985" Jun 13 00:56:38.021517 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.021496 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:38.840522 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.840494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:38.840522 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.840518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:38.840753 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:38.840606 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:38.840753 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:38.840609 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:38.840753 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:38.840678 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:38.840909 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:38.840751 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:39.010423 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.010398 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 00:56:39.010985 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.010714 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" event={"ID":"6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c","Type":"ContainerStarted","Data":"781e6462edd3cac188cb375dad3951de96abda8423dba0594f98d016bd4eba17"} Jun 13 00:56:39.011051 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.011013 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:39.026522 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.026496 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:56:39.038222 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.038168 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" podStartSLOduration=9.355167284 podStartE2EDuration="28.038154644s" totalImagesPullingTime="18.68298736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:39.03702496 +0000 UTC m=+28.598519418" watchObservedRunningTime="2026-06-13 00:56:39.038154644 +0000 UTC m=+28.599649134" Jun 13 00:56:39.342801 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.342510 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z5vzw"] Jun 13 00:56:39.342970 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.342918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:39.343034 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:39.343015 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:39.346984 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.346961 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mwctw"] Jun 13 00:56:39.347083 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.347068 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:39.347183 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:39.347166 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:39.354223 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.354156 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmmsp"] Jun 13 00:56:39.354341 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:39.354268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:39.354399 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:39.354364 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:40.015213 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:40.015179 2563 generic.go:356] "Generic (PLEG): container finished" podID="f8b60e61-3e20-4f03-9dfe-995005d3f54e" containerID="8f4219bdfe144457d0ca59e11e0e331c711e9f15219ad43b075f5d02689fdb96" exitCode=0 Jun 13 00:56:40.015720 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:40.015247 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" event={"ID":"f8b60e61-3e20-4f03-9dfe-995005d3f54e","Type":"ContainerDied","Data":"8f4219bdfe144457d0ca59e11e0e331c711e9f15219ad43b075f5d02689fdb96"} Jun 13 00:56:40.839343 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:40.839317 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:40.839517 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:40.839385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:40.839517 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:40.839425 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:40.839517 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:40.839456 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:40.839517 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:40.839495 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:40.839656 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:40.839563 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:42.022685 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:42.022656 2563 generic.go:356] "Generic (PLEG): container finished" podID="f8b60e61-3e20-4f03-9dfe-995005d3f54e" containerID="cb4adafde7f86cd52f6dc98b5b2d5576f5f31951a6138a93397605cdd2e802c9" exitCode=0 Jun 13 00:56:42.023332 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:42.022712 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" event={"ID":"f8b60e61-3e20-4f03-9dfe-995005d3f54e","Type":"ContainerDied","Data":"cb4adafde7f86cd52f6dc98b5b2d5576f5f31951a6138a93397605cdd2e802c9"} Jun 13 00:56:42.837326 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:42.837291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:42.837326 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:42.837315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:42.837555 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:42.837435 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:42.837555 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:42.837445 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:42.837555 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:42.837502 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:42.837717 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:42.837576 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:44.521028 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:44.520986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:44.521422 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.521160 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:44.521422 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.521230 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs podName:0b453c90-0c91-4ff6-ad96-12871a0d8224 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:16.521212827 +0000 UTC m=+66.082707266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs") pod "network-metrics-daemon-mwctw" (UID: "0b453c90-0c91-4ff6-ad96-12871a0d8224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:56:44.621847 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:44.621810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:44.622020 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.621977 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:44.622091 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.622056 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret podName:0bd84a45-1f89-4332-b546-bbefc0576148 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:16.622034137 +0000 UTC m=+66.183528590 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret") pod "global-pull-secret-syncer-z5vzw" (UID: "0bd84a45-1f89-4332-b546-bbefc0576148") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:56:44.722278 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:44.722245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:44.722465 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.722436 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:56:44.722465 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.722461 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:56:44.722557 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.722473 2563 projected.go:196] Error preparing data for projected volume kube-api-access-7llbl for pod openshift-network-diagnostics/network-check-target-wmmsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:44.722557 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.722529 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl podName:19a1fb30-9a8b-4570-9bd4-791902241de9 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:16.722510964 +0000 UTC m=+66.284005407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7llbl" (UniqueName: "kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl") pod "network-check-target-wmmsp" (UID: "19a1fb30-9a8b-4570-9bd4-791902241de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:56:44.837303 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:44.837265 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:44.837303 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:44.837285 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:44.837531 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:44.837265 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:44.837531 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.837391 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:56:44.837531 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.837492 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z5vzw" podUID="0bd84a45-1f89-4332-b546-bbefc0576148" Jun 13 00:56:44.837628 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:44.837579 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmmsp" podUID="19a1fb30-9a8b-4570-9bd4-791902241de9" Jun 13 00:56:45.204179 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.204101 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-95.ec2.internal" event="NodeReady" Jun 13 00:56:45.204345 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.204267 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 00:56:45.250487 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.250456 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-scrkc"] Jun 13 00:56:45.281962 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.281931 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vzmpn"] Jun 13 00:56:45.282102 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.282049 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.284054 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.284030 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 00:56:45.284054 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.284047 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 00:56:45.284054 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.284056 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7d8x8\"" Jun 13 00:56:45.295747 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.295714 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-scrkc"] Jun 13 00:56:45.295862 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.295825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vzmpn" Jun 13 00:56:45.295862 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.295848 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vzmpn"] Jun 13 00:56:45.297726 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.297705 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 00:56:45.297868 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.297816 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 00:56:45.297967 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.297952 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bnjss\"" Jun 13 00:56:45.298142 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.298129 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 00:56:45.428329 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.428296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7-cert\") pod \"ingress-canary-vzmpn\" (UID: \"9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7\") " pod="openshift-ingress-canary/ingress-canary-vzmpn" Jun 13 00:56:45.428504 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.428345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtmtd\" (UniqueName: \"kubernetes.io/projected/9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7-kube-api-access-rtmtd\") pod \"ingress-canary-vzmpn\" (UID: \"9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7\") " pod="openshift-ingress-canary/ingress-canary-vzmpn" Jun 13 00:56:45.428504 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.428386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0dbf9ed9-980c-4b0e-8741-095d948b68ce-config-volume\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.428504 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.428404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9hsq\" (UniqueName: \"kubernetes.io/projected/0dbf9ed9-980c-4b0e-8741-095d948b68ce-kube-api-access-p9hsq\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.428504 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.428435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.428504 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.428503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dbf9ed9-980c-4b0e-8741-095d948b68ce-tmp-dir\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.529607 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.529571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtmtd\" (UniqueName: \"kubernetes.io/projected/9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7-kube-api-access-rtmtd\") pod \"ingress-canary-vzmpn\" (UID: \"9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7\") " pod="openshift-ingress-canary/ingress-canary-vzmpn" Jun 13 00:56:45.530139 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.529646 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0dbf9ed9-980c-4b0e-8741-095d948b68ce-config-volume\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.530139 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.529675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9hsq\" (UniqueName: \"kubernetes.io/projected/0dbf9ed9-980c-4b0e-8741-095d948b68ce-kube-api-access-p9hsq\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.530139 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.529701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.530139 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.529771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dbf9ed9-980c-4b0e-8741-095d948b68ce-tmp-dir\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.530139 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.529820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7-cert\") pod \"ingress-canary-vzmpn\" (UID: \"9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7\") " pod="openshift-ingress-canary/ingress-canary-vzmpn" Jun 13 00:56:45.530139 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:45.530035 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:45.530139 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:45.530084 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls podName:0dbf9ed9-980c-4b0e-8741-095d948b68ce nodeName:}" failed. No retries permitted until 2026-06-13 00:56:46.03007018 +0000 UTC m=+35.591564617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls") pod "dns-default-scrkc" (UID: "0dbf9ed9-980c-4b0e-8741-095d948b68ce") : secret "dns-default-metrics-tls" not found Jun 13 00:56:45.530404 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.530240 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0dbf9ed9-980c-4b0e-8741-095d948b68ce-config-volume\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.530450 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.530437 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dbf9ed9-980c-4b0e-8741-095d948b68ce-tmp-dir\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.534460 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.534438 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7-cert\") pod \"ingress-canary-vzmpn\" (UID: \"9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7\") " pod="openshift-ingress-canary/ingress-canary-vzmpn" Jun 13 00:56:45.540871 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.540694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtmtd\" (UniqueName: \"kubernetes.io/projected/9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7-kube-api-access-rtmtd\") pod \"ingress-canary-vzmpn\" (UID: \"9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7\") " pod="openshift-ingress-canary/ingress-canary-vzmpn" Jun 13 00:56:45.542282 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.542259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9hsq\" (UniqueName: \"kubernetes.io/projected/0dbf9ed9-980c-4b0e-8741-095d948b68ce-kube-api-access-p9hsq\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:45.605410 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:45.605368 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vzmpn" Jun 13 00:56:46.033991 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.033960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:46.034243 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:46.034138 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:46.034243 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:46.034213 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls podName:0dbf9ed9-980c-4b0e-8741-095d948b68ce nodeName:}" failed. No retries permitted until 2026-06-13 00:56:47.034192941 +0000 UTC m=+36.595687394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls") pod "dns-default-scrkc" (UID: "0dbf9ed9-980c-4b0e-8741-095d948b68ce") : secret "dns-default-metrics-tls" not found Jun 13 00:56:46.041966 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.041898 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vzmpn"] Jun 13 00:56:46.047131 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:56:46.047104 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e17608a_fb6f_4b7d_acb3_fcdf4bab3ed7.slice/crio-8f7d5089b6b8ececafb8e4776cbda954fd974952deec8b3fc1c38134cdcbed18 WatchSource:0}: Error finding container 8f7d5089b6b8ececafb8e4776cbda954fd974952deec8b3fc1c38134cdcbed18: Status 404 returned error can't find the container with id 8f7d5089b6b8ececafb8e4776cbda954fd974952deec8b3fc1c38134cdcbed18 Jun 13 00:56:46.837819 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.837780 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:56:46.838368 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.837781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:56:46.838368 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.837781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:56:46.841417 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.841395 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 00:56:46.841797 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.841778 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-clqbp\"" Jun 13 00:56:46.841889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.841776 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 00:56:46.841889 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.841814 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 00:56:46.842208 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.842192 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m8nk7\"" Jun 13 00:56:46.842280 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:46.842248 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 00:56:47.038860 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:47.038827 2563 generic.go:356] "Generic (PLEG): container finished" podID="f8b60e61-3e20-4f03-9dfe-995005d3f54e" containerID="7fd36f70c37c079dce25a8eaa47b00fd44a0adddb51061a92abeb24b16760e44" exitCode=0 Jun 13 00:56:47.039045 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:47.038905 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" event={"ID":"f8b60e61-3e20-4f03-9dfe-995005d3f54e","Type":"ContainerDied","Data":"7fd36f70c37c079dce25a8eaa47b00fd44a0adddb51061a92abeb24b16760e44"} Jun 13 00:56:47.039975 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:47.039953 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vzmpn" event={"ID":"9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7","Type":"ContainerStarted","Data":"8f7d5089b6b8ececafb8e4776cbda954fd974952deec8b3fc1c38134cdcbed18"} Jun 13 00:56:47.041208 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:47.041183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:47.041319 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:47.041307 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:47.041389 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:47.041376 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls podName:0dbf9ed9-980c-4b0e-8741-095d948b68ce nodeName:}" failed. No retries permitted until 2026-06-13 00:56:49.041354644 +0000 UTC m=+38.602849101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls") pod "dns-default-scrkc" (UID: "0dbf9ed9-980c-4b0e-8741-095d948b68ce") : secret "dns-default-metrics-tls" not found Jun 13 00:56:48.043636 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:48.043607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vzmpn" event={"ID":"9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7","Type":"ContainerStarted","Data":"5745a5766bf71ed6a41c475188f8b1f97573d826f24c2708dcde0b82d3d732d2"} Jun 13 00:56:48.046536 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:48.046512 2563 generic.go:356] "Generic (PLEG): container finished" podID="f8b60e61-3e20-4f03-9dfe-995005d3f54e" containerID="85617b6ce74d1a8b9efc4065fc368ce98e1af3d68409a3e0813bed492604e241" exitCode=0 Jun 13 00:56:48.046673 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:48.046559 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" event={"ID":"f8b60e61-3e20-4f03-9dfe-995005d3f54e","Type":"ContainerDied","Data":"85617b6ce74d1a8b9efc4065fc368ce98e1af3d68409a3e0813bed492604e241"} Jun 13 00:56:48.097884 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:48.097827 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vzmpn" podStartSLOduration=1.485483246 podStartE2EDuration="3.09780641s" totalImagesPullingTime="1.612323164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:48.064245839 +0000 UTC m=+37.625740298" watchObservedRunningTime="2026-06-13 00:56:48.09780641 +0000 UTC m=+37.659300870" Jun 13 00:56:49.052361 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:49.052324 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" event={"ID":"f8b60e61-3e20-4f03-9dfe-995005d3f54e","Type":"ContainerStarted","Data":"c2c813a5b56dfca68b1acf988705ef0b2226213c3d968d846f4c08f4358a7de9"} Jun 13 00:56:49.054915 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:49.054895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:49.055042 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:49.055028 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:49.055090 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:49.055080 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls podName:0dbf9ed9-980c-4b0e-8741-095d948b68ce nodeName:}" failed. No retries permitted until 2026-06-13 00:56:53.055066681 +0000 UTC m=+42.616561117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls") pod "dns-default-scrkc" (UID: "0dbf9ed9-980c-4b0e-8741-095d948b68ce") : secret "dns-default-metrics-tls" not found Jun 13 00:56:49.075328 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:49.075284 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dvn5g" podStartSLOduration=9.27021488 podStartE2EDuration="38.075270167s" totalImagesPullingTime="28.805055287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:56:49.074046325 +0000 UTC m=+38.635540793" watchObservedRunningTime="2026-06-13 00:56:49.075270167 +0000 UTC m=+38.636764658" Jun 13 00:56:53.081415 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:56:53.081374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:56:53.082018 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:53.081584 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:56:53.082018 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:56:53.081660 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls podName:0dbf9ed9-980c-4b0e-8741-095d948b68ce nodeName:}" failed. No retries permitted until 2026-06-13 00:57:01.081639141 +0000 UTC m=+50.643133591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls") pod "dns-default-scrkc" (UID: "0dbf9ed9-980c-4b0e-8741-095d948b68ce") : secret "dns-default-metrics-tls" not found Jun 13 00:57:01.145002 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:01.144960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:57:01.145572 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:57:01.145144 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:57:01.145572 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:57:01.145230 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls podName:0dbf9ed9-980c-4b0e-8741-095d948b68ce nodeName:}" failed. No retries permitted until 2026-06-13 00:57:17.145207374 +0000 UTC m=+66.706701810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls") pod "dns-default-scrkc" (UID: "0dbf9ed9-980c-4b0e-8741-095d948b68ce") : secret "dns-default-metrics-tls" not found Jun 13 00:57:11.028494 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:11.028464 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l98pw" Jun 13 00:57:16.555618 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.555578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:57:16.558237 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.558211 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 00:57:16.566179 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:57:16.566157 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 00:57:16.566279 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:57:16.566239 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs podName:0b453c90-0c91-4ff6-ad96-12871a0d8224 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:20.566221543 +0000 UTC m=+130.127715997 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs") pod "network-metrics-daemon-mwctw" (UID: "0b453c90-0c91-4ff6-ad96-12871a0d8224") : secret "metrics-daemon-secret" not found Jun 13 00:57:16.655891 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.655851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:57:16.658414 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.658395 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 00:57:16.670805 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.670776 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0bd84a45-1f89-4332-b546-bbefc0576148-original-pull-secret\") pod \"global-pull-secret-syncer-z5vzw\" (UID: \"0bd84a45-1f89-4332-b546-bbefc0576148\") " pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:57:16.756470 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.756427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:57:16.758981 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.758961 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 00:57:16.769457 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.769430 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 00:57:16.780468 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.780434 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7llbl\" (UniqueName: \"kubernetes.io/projected/19a1fb30-9a8b-4570-9bd4-791902241de9-kube-api-access-7llbl\") pod \"network-check-target-wmmsp\" (UID: \"19a1fb30-9a8b-4570-9bd4-791902241de9\") " pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:57:16.850536 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.850460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z5vzw" Jun 13 00:57:16.860666 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.860639 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-clqbp\"" Jun 13 00:57:16.868249 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.868223 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:57:16.982144 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.982113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z5vzw"] Jun 13 00:57:16.987127 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:57:16.987101 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd84a45_1f89_4332_b546_bbefc0576148.slice/crio-ee929198f98d8665ce46c6782421569a941f9fa39861c9929a1f59f6b6e21d09 WatchSource:0}: Error finding container ee929198f98d8665ce46c6782421569a941f9fa39861c9929a1f59f6b6e21d09: Status 404 returned error can't find the container with id ee929198f98d8665ce46c6782421569a941f9fa39861c9929a1f59f6b6e21d09 Jun 13 00:57:16.999771 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:16.999729 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmmsp"] Jun 13 00:57:17.002808 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:57:17.002784 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a1fb30_9a8b_4570_9bd4_791902241de9.slice/crio-62440d95efcb845137a8241feda4671ef516af0c5732f26a369b0a0cee2fcb1b WatchSource:0}: Error finding container 62440d95efcb845137a8241feda4671ef516af0c5732f26a369b0a0cee2fcb1b: Status 404 returned error can't find the container with id 62440d95efcb845137a8241feda4671ef516af0c5732f26a369b0a0cee2fcb1b Jun 13 00:57:17.116305 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:17.116210 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmmsp" event={"ID":"19a1fb30-9a8b-4570-9bd4-791902241de9","Type":"ContainerStarted","Data":"62440d95efcb845137a8241feda4671ef516af0c5732f26a369b0a0cee2fcb1b"} Jun 13 00:57:17.117242 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:17.117212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z5vzw" event={"ID":"0bd84a45-1f89-4332-b546-bbefc0576148","Type":"ContainerStarted","Data":"ee929198f98d8665ce46c6782421569a941f9fa39861c9929a1f59f6b6e21d09"} Jun 13 00:57:17.160193 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:17.160159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:57:17.160325 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:57:17.160282 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:57:17.160365 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:57:17.160339 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls podName:0dbf9ed9-980c-4b0e-8741-095d948b68ce nodeName:}" failed. No retries permitted until 2026-06-13 00:57:49.160322082 +0000 UTC m=+98.721816522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls") pod "dns-default-scrkc" (UID: "0dbf9ed9-980c-4b0e-8741-095d948b68ce") : secret "dns-default-metrics-tls" not found Jun 13 00:57:22.130788 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:22.130749 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmmsp" event={"ID":"19a1fb30-9a8b-4570-9bd4-791902241de9","Type":"ContainerStarted","Data":"dc1582fcb46b971971480d560a7ce1c745231c14bc68f4bb09cb7e8ae8480a86"} Jun 13 00:57:22.131242 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:22.130851 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:57:22.132163 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:22.132136 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z5vzw" event={"ID":"0bd84a45-1f89-4332-b546-bbefc0576148","Type":"ContainerStarted","Data":"69afd24771a6c02fc1ff10703ee31480575c51cb0531f7407140057b81071e5a"} Jun 13 00:57:22.162384 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:22.162337 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wmmsp" podStartSLOduration=66.913805584 podStartE2EDuration="1m11.162322668s" totalImagesPullingTime="4.248517084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:57:22.16111371 +0000 UTC m=+71.722608169" watchObservedRunningTime="2026-06-13 00:57:22.162322668 +0000 UTC m=+71.723817126" Jun 13 00:57:28.087059 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.086993 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z5vzw" podStartSLOduration=72.820462936 podStartE2EDuration="1m17.08696531s" totalImagesPullingTime="4.266502374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:57:22.183663882 +0000 UTC m=+71.745158340" watchObservedRunningTime="2026-06-13 00:57:28.08696531 +0000 UTC m=+77.648459746" Jun 13 00:57:28.087883 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.087865 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc"] Jun 13 00:57:28.089568 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.089554 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.092153 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.092133 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 13 00:57:28.092281 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.092196 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 13 00:57:28.092387 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.092371 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 13 00:57:28.092591 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.092572 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 13 00:57:28.092866 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.092850 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 13 00:57:28.092936 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.092858 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 13 00:57:28.092936 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.092893 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 13 00:57:28.102788 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.102769 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc"] Jun 13 00:57:28.134247 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.134218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55xp9\" (UniqueName: \"kubernetes.io/projected/9aa740eb-1e54-4869-886e-03cd68f43fbf-kube-api-access-55xp9\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.134413 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.134262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-hub\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.134413 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.134303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-ca\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.134413 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.134335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.134413 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.134379 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa740eb-1e54-4869-886e-03cd68f43fbf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.134413 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.134406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.235435 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.235391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-ca\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.235435 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.235432 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.235680 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.235460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa740eb-1e54-4869-886e-03cd68f43fbf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.235680 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.235486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.235680 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.235540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55xp9\" (UniqueName: \"kubernetes.io/projected/9aa740eb-1e54-4869-886e-03cd68f43fbf-kube-api-access-55xp9\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.235680 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.235582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-hub\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.236197 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.236170 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aa740eb-1e54-4869-886e-03cd68f43fbf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.237997 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.237966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-ca\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.238088 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.238029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.238351 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.238334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-hub\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.238419 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.238344 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9aa740eb-1e54-4869-886e-03cd68f43fbf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.243596 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.243574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55xp9\" (UniqueName: \"kubernetes.io/projected/9aa740eb-1e54-4869-886e-03cd68f43fbf-kube-api-access-55xp9\") pod \"cluster-proxy-proxy-agent-5b9db955bb-52mcc\" (UID: \"9aa740eb-1e54-4869-886e-03cd68f43fbf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.417028 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.416929 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 00:57:28.538453 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:28.538419 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc"] Jun 13 00:57:28.542550 ip-10-0-129-95 kubenswrapper[2563]: W0613 00:57:28.542524 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9aa740eb_1e54_4869_886e_03cd68f43fbf.slice/crio-c6b3554bd0268f6a048374bf2ad538665333b594aa4dbafd1ac2a230a3d6b5fa WatchSource:0}: Error finding container c6b3554bd0268f6a048374bf2ad538665333b594aa4dbafd1ac2a230a3d6b5fa: Status 404 returned error can't find the container with id c6b3554bd0268f6a048374bf2ad538665333b594aa4dbafd1ac2a230a3d6b5fa Jun 13 00:57:29.151207 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:29.151158 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" event={"ID":"9aa740eb-1e54-4869-886e-03cd68f43fbf","Type":"ContainerStarted","Data":"c6b3554bd0268f6a048374bf2ad538665333b594aa4dbafd1ac2a230a3d6b5fa"} Jun 13 00:57:32.162174 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:32.162135 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" event={"ID":"9aa740eb-1e54-4869-886e-03cd68f43fbf","Type":"ContainerStarted","Data":"4b2c960280e96750a26027168148d4d547710c0673bfd48bc00fe6bc11fdf503"} Jun 13 00:57:32.162174 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:32.162179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" event={"ID":"9aa740eb-1e54-4869-886e-03cd68f43fbf","Type":"ContainerStarted","Data":"5058fe94806e62daea81da384eca2c51929dd9d7488c03e0232b0ef017a43bd5"} Jun 13 00:57:32.162675 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:32.162192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" event={"ID":"9aa740eb-1e54-4869-886e-03cd68f43fbf","Type":"ContainerStarted","Data":"06229223d724e3bd971b60a5999459b3e2cc3d9b860684c7101bd656c49c71d9"} Jun 13 00:57:32.183545 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:32.183493 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" podStartSLOduration=1.019324499 podStartE2EDuration="4.183477355s" totalImagesPullingTime="3.164152856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:57:32.182921604 +0000 UTC m=+81.744416087" watchObservedRunningTime="2026-06-13 00:57:32.183477355 +0000 UTC m=+81.744971813" Jun 13 00:57:49.184963 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:49.184863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:57:49.185321 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:57:49.185033 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:57:49.185321 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:57:49.185102 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls podName:0dbf9ed9-980c-4b0e-8741-095d948b68ce nodeName:}" failed. No retries permitted until 2026-06-13 00:58:53.185084851 +0000 UTC m=+162.746579291 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls") pod "dns-default-scrkc" (UID: "0dbf9ed9-980c-4b0e-8741-095d948b68ce") : secret "dns-default-metrics-tls" not found Jun 13 00:57:53.137796 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:57:53.137765 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wmmsp" Jun 13 00:58:20.597549 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:58:20.597495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 00:58:20.598069 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:58:20.597638 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 00:58:20.598069 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:58:20.597718 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs podName:0b453c90-0c91-4ff6-ad96-12871a0d8224 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:22.597698773 +0000 UTC m=+252.159193210 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs") pod "network-metrics-daemon-mwctw" (UID: "0b453c90-0c91-4ff6-ad96-12871a0d8224") : secret "metrics-daemon-secret" not found Jun 13 00:58:48.292197 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:58:48.292153 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-scrkc" podUID="0dbf9ed9-980c-4b0e-8741-095d948b68ce" Jun 13 00:58:48.377243 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:58:48.377216 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-scrkc" Jun 13 00:58:49.864149 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:58:49.864094 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mwctw" podUID="0b453c90-0c91-4ff6-ad96-12871a0d8224" Jun 13 00:58:53.224516 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:58:53.224443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 00:58:53.224877 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:58:53.224564 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 00:58:53.224877 ip-10-0-129-95 kubenswrapper[2563]: E0613 00:58:53.224616 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls podName:0dbf9ed9-980c-4b0e-8741-095d948b68ce nodeName:}" failed. No retries permitted until 2026-06-13 01:00:55.224602921 +0000 UTC m=+284.786097356 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls") pod "dns-default-scrkc" (UID: "0dbf9ed9-980c-4b0e-8741-095d948b68ce") : secret "dns-default-metrics-tls" not found Jun 13 00:59:02.838081 ip-10-0-129-95 kubenswrapper[2563]: I0613 00:59:02.838044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 01:00:03.351678 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.351636 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77"] Jun 13 01:00:03.354718 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.354693 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77" Jun 13 01:00:03.360157 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.360126 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-96j84\"" Jun 13 01:00:03.360338 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.360275 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 13 01:00:03.360818 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.360667 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 13 01:00:03.372061 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.372024 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77"] Jun 13 01:00:03.391468 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.391412 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r4qfq"] Jun 13 01:00:03.394408 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.394383 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.396664 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.396632 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 01:00:03.396817 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.396631 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 01:00:03.396817 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.396634 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 01:00:03.396817 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.396730 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 01:00:03.396817 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.396766 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7pqf\"" Jun 13 01:00:03.406183 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.406156 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r4qfq"] Jun 13 01:00:03.497773 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.497715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8blsp\" (UniqueName: \"kubernetes.io/projected/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-api-access-8blsp\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.497773 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.497779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-crio-socket\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.498003 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.497867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-data-volume\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.498003 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.497915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.498003 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.497936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.498003 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.497958 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwf79\" (UniqueName: \"kubernetes.io/projected/564d7fe6-38f1-439d-b876-1935870bd7e4-kube-api-access-xwf79\") pod \"migrator-d4bcd4867-vfq77\" (UID: \"564d7fe6-38f1-439d-b876-1935870bd7e4\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77" Jun 13 01:00:03.598777 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.598717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-data-volume\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.598777 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.598786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.599016 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:03.598873 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:03.599016 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:03.598929 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:04.098912206 +0000 UTC m=+233.660406642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:03.599016 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.598943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.599016 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.598961 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwf79\" (UniqueName: \"kubernetes.io/projected/564d7fe6-38f1-439d-b876-1935870bd7e4-kube-api-access-xwf79\") pod \"migrator-d4bcd4867-vfq77\" (UID: \"564d7fe6-38f1-439d-b876-1935870bd7e4\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77" Jun 13 01:00:03.599016 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.598996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8blsp\" (UniqueName: \"kubernetes.io/projected/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-api-access-8blsp\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.599246 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.599029 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-crio-socket\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.599246 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:03.599043 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:03.599246 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.599078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-data-volume\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.599246 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:03.599105 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:04.099087872 +0000 UTC m=+233.660582322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : configmap "kube-rbac-proxy" not found Jun 13 01:00:03.599246 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.599124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-crio-socket\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.606516 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.606450 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8blsp\" (UniqueName: \"kubernetes.io/projected/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-api-access-8blsp\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:03.607945 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.607921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwf79\" (UniqueName: \"kubernetes.io/projected/564d7fe6-38f1-439d-b876-1935870bd7e4-kube-api-access-xwf79\") pod \"migrator-d4bcd4867-vfq77\" (UID: \"564d7fe6-38f1-439d-b876-1935870bd7e4\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77" Jun 13 01:00:03.663492 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.663453 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77" Jun 13 01:00:03.788051 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:03.788018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77"] Jun 13 01:00:03.791225 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:00:03.791186 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564d7fe6_38f1_439d_b876_1935870bd7e4.slice/crio-d66a6cf36945e5fe85ee39303fd786084e020d07509848468321cd8c5ad58317 WatchSource:0}: Error finding container d66a6cf36945e5fe85ee39303fd786084e020d07509848468321cd8c5ad58317: Status 404 returned error can't find the container with id d66a6cf36945e5fe85ee39303fd786084e020d07509848468321cd8c5ad58317 Jun 13 01:00:04.103670 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:04.103628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:04.103670 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:04.103672 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:04.103914 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:04.103783 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:04.103914 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:04.103807 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:04.103914 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:04.103849 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:05.103830997 +0000 UTC m=+234.665325436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : configmap "kube-rbac-proxy" not found Jun 13 01:00:04.103914 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:04.103864 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:05.103857886 +0000 UTC m=+234.665352321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:04.582093 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:04.582055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77" event={"ID":"564d7fe6-38f1-439d-b876-1935870bd7e4","Type":"ContainerStarted","Data":"d66a6cf36945e5fe85ee39303fd786084e020d07509848468321cd8c5ad58317"} Jun 13 01:00:05.112675 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:05.112639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:05.112675 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:05.112673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:05.112898 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:05.112777 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:05.112898 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:05.112802 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:05.112898 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:05.112841 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:07.112823007 +0000 UTC m=+236.674317446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : configmap "kube-rbac-proxy" not found Jun 13 01:00:05.112898 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:05.112854 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:07.112848761 +0000 UTC m=+236.674343196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:05.163000 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:05.162971 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-84mtz_78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65/dns-node-resolver/0.log" Jun 13 01:00:05.586944 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:05.586908 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77" event={"ID":"564d7fe6-38f1-439d-b876-1935870bd7e4","Type":"ContainerStarted","Data":"7f6e4f6620b7a2a905145bcc4fa35ccfa40563227ae8b5d18d9de631ebd1b39c"} Jun 13 01:00:05.587443 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:05.586964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77" event={"ID":"564d7fe6-38f1-439d-b876-1935870bd7e4","Type":"ContainerStarted","Data":"65b6839b29fc02699a4397fcbd7b10775a7aad340902b5460107ad6d203c9ff8"} Jun 13 01:00:05.600898 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:05.600842 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vfq77" podStartSLOduration=1.465897161 podStartE2EDuration="2.600822977s" totalImagesPullingTime="1.134925816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:05.600328074 +0000 UTC m=+235.161822533" watchObservedRunningTime="2026-06-13 01:00:05.600822977 +0000 UTC m=+235.162317431" Jun 13 01:00:06.560599 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:06.560570 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zdvtn_d9ab10e4-4aee-4ed0-8fe2-918be94d1533/node-ca/0.log" Jun 13 01:00:07.128985 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:07.128943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:07.128985 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:07.128987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:07.129409 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:07.129070 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:07.129409 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:07.129098 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:07.129409 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:07.129139 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:11.12912186 +0000 UTC m=+240.690616299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : configmap "kube-rbac-proxy" not found Jun 13 01:00:07.129409 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:07.129153 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:11.129147318 +0000 UTC m=+240.690641754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:07.163859 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:07.163834 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vzmpn_9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7/serve-healthcheck-canary/0.log" Jun 13 01:00:11.159963 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:11.159926 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:11.159963 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:11.159964 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:11.160521 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:11.160059 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:00:11.160521 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:11.160091 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:00:11.160521 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:11.160115 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:19.160098555 +0000 UTC m=+248.721592994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : configmap "kube-rbac-proxy" not found Jun 13 01:00:11.160521 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:11.160155 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls podName:f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:19.160138633 +0000 UTC m=+248.721633070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4qfq" (UID: "f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8") : secret "insights-runtime-extractor-tls" not found Jun 13 01:00:19.223875 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:19.223836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:19.223875 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:19.223875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:19.224348 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:19.224332 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:19.226097 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:19.226075 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4qfq\" (UID: \"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8\") " pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:19.305679 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:19.305650 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7pqf\"" Jun 13 01:00:19.314189 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:19.314171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r4qfq" Jun 13 01:00:19.443551 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:19.443518 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r4qfq"] Jun 13 01:00:19.447233 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:00:19.447205 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70b5b9e_17f4_4d6f_ae3e_6bf6e897bed8.slice/crio-9433a3ba5fddc406f3d20bbeea21ef3bc0c59db2a559a5e208b9a89db7524001 WatchSource:0}: Error finding container 9433a3ba5fddc406f3d20bbeea21ef3bc0c59db2a559a5e208b9a89db7524001: Status 404 returned error can't find the container with id 9433a3ba5fddc406f3d20bbeea21ef3bc0c59db2a559a5e208b9a89db7524001 Jun 13 01:00:19.630877 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:19.630848 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r4qfq" event={"ID":"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8","Type":"ContainerStarted","Data":"9433a3ba5fddc406f3d20bbeea21ef3bc0c59db2a559a5e208b9a89db7524001"} Jun 13 01:00:22.648902 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:22.648806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 01:00:22.651270 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:22.651244 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b453c90-0c91-4ff6-ad96-12871a0d8224-metrics-certs\") pod \"network-metrics-daemon-mwctw\" (UID: \"0b453c90-0c91-4ff6-ad96-12871a0d8224\") " pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 01:00:22.941183 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:22.941102 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m8nk7\"" Jun 13 01:00:22.949892 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:22.949867 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mwctw" Jun 13 01:00:23.077030 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:23.077000 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mwctw"] Jun 13 01:00:23.080235 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:00:23.080210 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b453c90_0c91_4ff6_ad96_12871a0d8224.slice/crio-c2c27e832ce6146b85b3c212804e273a853b2d3912e9414fe6d3a48dad07f707 WatchSource:0}: Error finding container c2c27e832ce6146b85b3c212804e273a853b2d3912e9414fe6d3a48dad07f707: Status 404 returned error can't find the container with id c2c27e832ce6146b85b3c212804e273a853b2d3912e9414fe6d3a48dad07f707 Jun 13 01:00:23.646680 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:23.646584 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r4qfq" event={"ID":"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8","Type":"ContainerStarted","Data":"4a3a2259895907f6091ff54b760711ed00a34b32aab415a2eb0c8be6b80f4855"} Jun 13 01:00:23.646680 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:23.646663 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r4qfq" event={"ID":"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8","Type":"ContainerStarted","Data":"4af01ec0d60fb56d1cee98d20ee1f2ed8b05325fcf7bbf201e6c3d06d9f6be6e"} Jun 13 01:00:23.647847 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:23.647815 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mwctw" event={"ID":"0b453c90-0c91-4ff6-ad96-12871a0d8224","Type":"ContainerStarted","Data":"c2c27e832ce6146b85b3c212804e273a853b2d3912e9414fe6d3a48dad07f707"} Jun 13 01:00:24.653302 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:24.653265 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mwctw" event={"ID":"0b453c90-0c91-4ff6-ad96-12871a0d8224","Type":"ContainerStarted","Data":"4d70a7ec31ab5d5951268392613b1a1d465bfa9188300572830edcc978232666"} Jun 13 01:00:24.653834 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:24.653333 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mwctw" event={"ID":"0b453c90-0c91-4ff6-ad96-12871a0d8224","Type":"ContainerStarted","Data":"60b0611f3f01867c945f5f0ec505374e36e2ffbacc106ed3d46d753e1e7d91c7"} Jun 13 01:00:24.670030 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:24.669682 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mwctw" podStartSLOduration=253.651928441 podStartE2EDuration="4m14.669660922s" totalImagesPullingTime="1.017732481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:24.668759031 +0000 UTC m=+254.230253490" watchObservedRunningTime="2026-06-13 01:00:24.669660922 +0000 UTC m=+254.231155382" Jun 13 01:00:25.658253 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:25.658213 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r4qfq" event={"ID":"f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8","Type":"ContainerStarted","Data":"b41d6e7fc5bb6cda3774d3516670522157c7f465d128e1c5ac25dc5d2d1b0de8"} Jun 13 01:00:25.678228 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:25.678177 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r4qfq" podStartSLOduration=17.20781886 podStartE2EDuration="22.678162625s" totalImagesPullingTime="5.470343765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:00:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:25.678021875 +0000 UTC m=+255.239516333" watchObservedRunningTime="2026-06-13 01:00:25.678162625 +0000 UTC m=+255.239657083" Jun 13 01:00:26.915909 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:26.915881 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b"] Jun 13 01:00:26.918858 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:26.918840 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" Jun 13 01:00:26.920653 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:26.920634 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 13 01:00:26.921096 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:26.921075 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kp4xd\"" Jun 13 01:00:26.931661 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:26.931640 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b"] Jun 13 01:00:27.083681 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:27.083640 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/52dd1544-2246-49a8-b58a-5f2750a0b7b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-4qs2b\" (UID: \"52dd1544-2246-49a8-b58a-5f2750a0b7b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" Jun 13 01:00:27.184603 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:27.184512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/52dd1544-2246-49a8-b58a-5f2750a0b7b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-4qs2b\" (UID: \"52dd1544-2246-49a8-b58a-5f2750a0b7b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" Jun 13 01:00:27.187075 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:27.187052 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/52dd1544-2246-49a8-b58a-5f2750a0b7b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-4qs2b\" (UID: \"52dd1544-2246-49a8-b58a-5f2750a0b7b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" Jun 13 01:00:27.227750 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:27.227716 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" Jun 13 01:00:27.353878 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:27.353836 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b"] Jun 13 01:00:27.358270 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:00:27.358240 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52dd1544_2246_49a8_b58a_5f2750a0b7b3.slice/crio-a90d103cdde7ccc29cd65aac1b97b371a3c82f1208ba5c04f989cadaf3a070f9 WatchSource:0}: Error finding container a90d103cdde7ccc29cd65aac1b97b371a3c82f1208ba5c04f989cadaf3a070f9: Status 404 returned error can't find the container with id a90d103cdde7ccc29cd65aac1b97b371a3c82f1208ba5c04f989cadaf3a070f9 Jun 13 01:00:27.666450 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:27.666415 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" event={"ID":"52dd1544-2246-49a8-b58a-5f2750a0b7b3","Type":"ContainerStarted","Data":"a90d103cdde7ccc29cd65aac1b97b371a3c82f1208ba5c04f989cadaf3a070f9"} Jun 13 01:00:28.418975 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:28.418923 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" podUID="9aa740eb-1e54-4869-886e-03cd68f43fbf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 01:00:28.670748 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:28.670647 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" event={"ID":"52dd1544-2246-49a8-b58a-5f2750a0b7b3","Type":"ContainerStarted","Data":"8a424e79af5657518f20ae21d780bb10249089b66d0d266addeb9dc5d913ae4e"} Jun 13 01:00:28.670898 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:28.670802 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" Jun 13 01:00:28.675297 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:28.675270 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" Jun 13 01:00:28.693071 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:28.693023 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-4qs2b" podStartSLOduration=1.73479498 podStartE2EDuration="2.69300716s" totalImagesPullingTime="958.21218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:28.691697563 +0000 UTC m=+258.253192017" watchObservedRunningTime="2026-06-13 01:00:28.69300716 +0000 UTC m=+258.254501618" Jun 13 01:00:33.502251 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.502215 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-28lbd"] Jun 13 01:00:33.505657 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.505634 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.507419 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.507394 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 01:00:33.507530 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.507481 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 01:00:33.507655 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.507640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 01:00:33.507876 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.507863 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5qpzh\"" Jun 13 01:00:33.508950 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.508930 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 01:00:33.509399 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.509382 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 01:00:33.509464 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.509401 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 01:00:33.631021 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.630982 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf7rz\" (UniqueName: \"kubernetes.io/projected/33b04eb2-96a0-4e7f-ba27-69da64783408-kube-api-access-lf7rz\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.631021 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.631023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33b04eb2-96a0-4e7f-ba27-69da64783408-root\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.631266 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.631058 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-textfile\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.631266 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.631117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33b04eb2-96a0-4e7f-ba27-69da64783408-metrics-client-ca\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.631266 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.631142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-tls\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.631266 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.631172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33b04eb2-96a0-4e7f-ba27-69da64783408-sys\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.631266 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.631199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.631418 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.631265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-accelerators-collector-config\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.631418 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.631309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-wtmp\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.732578 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-wtmp\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.732578 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf7rz\" (UniqueName: \"kubernetes.io/projected/33b04eb2-96a0-4e7f-ba27-69da64783408-kube-api-access-lf7rz\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.732870 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33b04eb2-96a0-4e7f-ba27-69da64783408-root\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.732870 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-textfile\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.732870 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/33b04eb2-96a0-4e7f-ba27-69da64783408-root\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.732870 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732732 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-wtmp\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.732870 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33b04eb2-96a0-4e7f-ba27-69da64783408-metrics-client-ca\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.732870 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-tls\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.733149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33b04eb2-96a0-4e7f-ba27-69da64783408-sys\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.733149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.733149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33b04eb2-96a0-4e7f-ba27-69da64783408-sys\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.733149 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:33.732990 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 13 01:00:33.733149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-accelerators-collector-config\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.733149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.732977 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-textfile\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.733149 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:33.733062 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-tls podName:33b04eb2-96a0-4e7f-ba27-69da64783408 nodeName:}" failed. No retries permitted until 2026-06-13 01:00:34.23304067 +0000 UTC m=+263.794535111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-tls") pod "node-exporter-28lbd" (UID: "33b04eb2-96a0-4e7f-ba27-69da64783408") : secret "node-exporter-tls" not found Jun 13 01:00:33.733463 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.733327 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33b04eb2-96a0-4e7f-ba27-69da64783408-metrics-client-ca\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.733463 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.733450 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-accelerators-collector-config\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.735202 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.735181 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:33.740191 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:33.740169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf7rz\" (UniqueName: \"kubernetes.io/projected/33b04eb2-96a0-4e7f-ba27-69da64783408-kube-api-access-lf7rz\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:34.236515 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:34.236475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-tls\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:34.238780 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:34.238763 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/33b04eb2-96a0-4e7f-ba27-69da64783408-node-exporter-tls\") pod \"node-exporter-28lbd\" (UID: \"33b04eb2-96a0-4e7f-ba27-69da64783408\") " pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:34.415479 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:34.415443 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-28lbd" Jun 13 01:00:34.427418 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:00:34.427385 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b04eb2_96a0_4e7f_ba27_69da64783408.slice/crio-fe9afd0d7e2d9ac71fa46676483675eaf99ac92198ffd86343c9cb4ec9329899 WatchSource:0}: Error finding container fe9afd0d7e2d9ac71fa46676483675eaf99ac92198ffd86343c9cb4ec9329899: Status 404 returned error can't find the container with id fe9afd0d7e2d9ac71fa46676483675eaf99ac92198ffd86343c9cb4ec9329899 Jun 13 01:00:34.689855 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:34.689807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-28lbd" event={"ID":"33b04eb2-96a0-4e7f-ba27-69da64783408","Type":"ContainerStarted","Data":"fe9afd0d7e2d9ac71fa46676483675eaf99ac92198ffd86343c9cb4ec9329899"} Jun 13 01:00:35.132401 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.132363 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cf6bb455f-lcdck"] Jun 13 01:00:35.136281 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.136251 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.138480 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.138455 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 01:00:35.138654 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.138616 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 01:00:35.138725 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.138679 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 01:00:35.138725 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.138689 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 01:00:35.138725 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.138704 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 01:00:35.139012 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.138988 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 01:00:35.139108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.139018 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-69z7j\"" Jun 13 01:00:35.139282 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.139269 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 01:00:35.145974 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.145912 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf6bb455f-lcdck"] Jun 13 01:00:35.244052 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.244014 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-serving-cert\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.244052 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.244056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-service-ca\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.244286 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.244104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpnj8\" (UniqueName: \"kubernetes.io/projected/12035b4c-70d7-4e13-92a5-ee25dc686885-kube-api-access-dpnj8\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.244286 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.244140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-console-config\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.244286 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.244165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-oauth-serving-cert\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.244286 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.244217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-oauth-config\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.345372 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.345334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-oauth-serving-cert\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.345542 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.345414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-oauth-config\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.345542 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.345459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-serving-cert\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.345668 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.345633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-service-ca\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.345723 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.345702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpnj8\" (UniqueName: \"kubernetes.io/projected/12035b4c-70d7-4e13-92a5-ee25dc686885-kube-api-access-dpnj8\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.345806 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.345763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-console-config\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.346165 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.346141 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-oauth-serving-cert\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.346287 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.346273 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-service-ca\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.346382 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.346360 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-console-config\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.348101 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.348078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-oauth-config\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.348195 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.348183 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-serving-cert\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.353472 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.353454 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpnj8\" (UniqueName: \"kubernetes.io/projected/12035b4c-70d7-4e13-92a5-ee25dc686885-kube-api-access-dpnj8\") pod \"console-6cf6bb455f-lcdck\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.447722 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.447697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:35.578603 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.578530 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf6bb455f-lcdck"] Jun 13 01:00:35.614753 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:00:35.614710 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12035b4c_70d7_4e13_92a5_ee25dc686885.slice/crio-3abc72e894231ca32b8d2ac9491d14cd2497bedd9b40e056b9f9779ccd292ef0 WatchSource:0}: Error finding container 3abc72e894231ca32b8d2ac9491d14cd2497bedd9b40e056b9f9779ccd292ef0: Status 404 returned error can't find the container with id 3abc72e894231ca32b8d2ac9491d14cd2497bedd9b40e056b9f9779ccd292ef0 Jun 13 01:00:35.694465 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.694380 2563 generic.go:356] "Generic (PLEG): container finished" podID="33b04eb2-96a0-4e7f-ba27-69da64783408" containerID="2c24653292937b75263830bd4d5c8ea7f2b5a910fcd1395f3280c3f8dce45af1" exitCode=0 Jun 13 01:00:35.694921 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.694467 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-28lbd" event={"ID":"33b04eb2-96a0-4e7f-ba27-69da64783408","Type":"ContainerDied","Data":"2c24653292937b75263830bd4d5c8ea7f2b5a910fcd1395f3280c3f8dce45af1"} Jun 13 01:00:35.699881 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:35.699852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf6bb455f-lcdck" event={"ID":"12035b4c-70d7-4e13-92a5-ee25dc686885","Type":"ContainerStarted","Data":"3abc72e894231ca32b8d2ac9491d14cd2497bedd9b40e056b9f9779ccd292ef0"} Jun 13 01:00:36.592981 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.592934 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58766b9554-dcgp6"] Jun 13 01:00:36.596645 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.596620 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.598797 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.598758 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 13 01:00:36.599036 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.599015 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5kp70amr8v6f6\"" Jun 13 01:00:36.599134 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.599022 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 13 01:00:36.599134 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.599091 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 13 01:00:36.599134 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.599027 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 13 01:00:36.599134 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.599130 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 13 01:00:36.599334 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.599203 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-twl8j\"" Jun 13 01:00:36.606544 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.606520 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58766b9554-dcgp6"] Jun 13 01:00:36.706978 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.706928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-28lbd" event={"ID":"33b04eb2-96a0-4e7f-ba27-69da64783408","Type":"ContainerStarted","Data":"53f4e1e500e8655f7b5b188231c063bdd20edd2c561fe046ac0bd2576022d5a9"} Jun 13 01:00:36.707419 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.706997 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-28lbd" event={"ID":"33b04eb2-96a0-4e7f-ba27-69da64783408","Type":"ContainerStarted","Data":"357c60ae63efe299889a6fa690d3ce1219d17b254bb10536ef72b63ef07bd1d1"} Jun 13 01:00:36.725062 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.725013 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-28lbd" podStartSLOduration=2.663026861 podStartE2EDuration="3.724990462s" totalImagesPullingTime="990.482217ms" totalInitContainerRuntime="71.481384ms" isStatefulPod=true podCreationTimestamp="2026-06-13 01:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:36.723971619 +0000 UTC m=+266.285466079" watchObservedRunningTime="2026-06-13 01:00:36.724990462 +0000 UTC m=+266.286484922" Jun 13 01:00:36.756749 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.756710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.756932 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.756776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-tls\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.756932 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.756803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-grpc-tls\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.756932 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.756846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd773d75-25e9-4d63-82c8-1962a7c0fac2-metrics-client-ca\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.756932 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.756893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.757102 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.756951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.757102 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.757028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvg4j\" (UniqueName: \"kubernetes.io/projected/fd773d75-25e9-4d63-82c8-1962a7c0fac2-kube-api-access-rvg4j\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.757102 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.757051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.858263 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.858185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.858427 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.858347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvg4j\" (UniqueName: \"kubernetes.io/projected/fd773d75-25e9-4d63-82c8-1962a7c0fac2-kube-api-access-rvg4j\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.858500 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.858433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.858558 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.858505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.858611 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.858554 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-tls\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.858611 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.858579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-grpc-tls\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.858760 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.858640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd773d75-25e9-4d63-82c8-1962a7c0fac2-metrics-client-ca\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.858760 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.858679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.859477 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.859416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd773d75-25e9-4d63-82c8-1962a7c0fac2-metrics-client-ca\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.861695 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.861653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.861832 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.861722 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.861937 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.861907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-grpc-tls\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.862065 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.861937 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.862127 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.862087 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-tls\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.862127 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.862097 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fd773d75-25e9-4d63-82c8-1962a7c0fac2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.866220 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.866198 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvg4j\" (UniqueName: \"kubernetes.io/projected/fd773d75-25e9-4d63-82c8-1962a7c0fac2-kube-api-access-rvg4j\") pod \"thanos-querier-58766b9554-dcgp6\" (UID: \"fd773d75-25e9-4d63-82c8-1962a7c0fac2\") " pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:36.907970 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:36.907926 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:37.058751 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:37.058704 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58766b9554-dcgp6"] Jun 13 01:00:38.075927 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:00:38.075895 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd773d75_25e9_4d63_82c8_1962a7c0fac2.slice/crio-48bb9e2c293ed26906743c7772db75607f7821f050516421ccd4a4a0081da436 WatchSource:0}: Error finding container 48bb9e2c293ed26906743c7772db75607f7821f050516421ccd4a4a0081da436: Status 404 returned error can't find the container with id 48bb9e2c293ed26906743c7772db75607f7821f050516421ccd4a4a0081da436 Jun 13 01:00:38.418110 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.418030 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" podUID="9aa740eb-1e54-4869-886e-03cd68f43fbf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 01:00:38.684517 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.684427 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74488b9889-lvx7z"] Jun 13 01:00:38.687688 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.687665 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.690146 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.690120 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 13 01:00:38.690270 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.690252 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 13 01:00:38.690333 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.690127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 13 01:00:38.690386 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.690359 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p2g8f\"" Jun 13 01:00:38.690569 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.690554 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 13 01:00:38.690569 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.690565 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 13 01:00:38.696200 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.696181 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 13 01:00:38.705246 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.705185 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74488b9889-lvx7z"] Jun 13 01:00:38.721355 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.721318 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf6bb455f-lcdck" event={"ID":"12035b4c-70d7-4e13-92a5-ee25dc686885","Type":"ContainerStarted","Data":"d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad"} Jun 13 01:00:38.722610 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.722580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" event={"ID":"fd773d75-25e9-4d63-82c8-1962a7c0fac2","Type":"ContainerStarted","Data":"48bb9e2c293ed26906743c7772db75607f7821f050516421ccd4a4a0081da436"} Jun 13 01:00:38.739318 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.739059 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cf6bb455f-lcdck" podStartSLOduration=1.230619712 podStartE2EDuration="3.739038204s" totalImagesPullingTime="2.508418492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:38.73767247 +0000 UTC m=+268.299166926" watchObservedRunningTime="2026-06-13 01:00:38.739038204 +0000 UTC m=+268.300532665" Jun 13 01:00:38.772816 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.772713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-secret-telemeter-client\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.772816 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.772768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beab5588-661b-462d-a966-5e604ee38eb2-serving-certs-ca-bundle\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.772816 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.772805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beab5588-661b-462d-a966-5e604ee38eb2-metrics-client-ca\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.773113 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.772863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz97s\" (UniqueName: \"kubernetes.io/projected/beab5588-661b-462d-a966-5e604ee38eb2-kube-api-access-jz97s\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.773113 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.772896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-telemeter-client-tls\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.773113 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.772917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-federate-client-tls\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.773113 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.772940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.773113 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.772969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beab5588-661b-462d-a966-5e604ee38eb2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.873408 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.873364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-telemeter-client-tls\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.873408 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.873405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-federate-client-tls\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.873660 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.873435 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.873660 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.873464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beab5588-661b-462d-a966-5e604ee38eb2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.873660 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.873545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-secret-telemeter-client\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.873840 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.873782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beab5588-661b-462d-a966-5e604ee38eb2-serving-certs-ca-bundle\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.873891 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.873858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beab5588-661b-462d-a966-5e604ee38eb2-metrics-client-ca\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.873943 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.873918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz97s\" (UniqueName: \"kubernetes.io/projected/beab5588-661b-462d-a966-5e604ee38eb2-kube-api-access-jz97s\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.874590 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.874560 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beab5588-661b-462d-a966-5e604ee38eb2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.874723 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.874567 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beab5588-661b-462d-a966-5e604ee38eb2-metrics-client-ca\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.874723 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.874640 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/beab5588-661b-462d-a966-5e604ee38eb2-serving-certs-ca-bundle\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.876370 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.876347 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-telemeter-client-tls\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.876602 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.876575 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.876855 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.876768 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-secret-telemeter-client\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.877255 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.877237 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/beab5588-661b-462d-a966-5e604ee38eb2-federate-client-tls\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.881311 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.881290 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz97s\" (UniqueName: \"kubernetes.io/projected/beab5588-661b-462d-a966-5e604ee38eb2-kube-api-access-jz97s\") pod \"telemeter-client-74488b9889-lvx7z\" (UID: \"beab5588-661b-462d-a966-5e604ee38eb2\") " pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:38.999301 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:38.999210 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" Jun 13 01:00:39.140180 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:39.139904 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74488b9889-lvx7z"] Jun 13 01:00:39.142558 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:00:39.142533 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeab5588_661b_462d_a966_5e604ee38eb2.slice/crio-ead4a087f35b0f6a66849b3bbd5cad88a4ba80681b37ac243e841e838f618c3c WatchSource:0}: Error finding container ead4a087f35b0f6a66849b3bbd5cad88a4ba80681b37ac243e841e838f618c3c: Status 404 returned error can't find the container with id ead4a087f35b0f6a66849b3bbd5cad88a4ba80681b37ac243e841e838f618c3c Jun 13 01:00:39.727631 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:39.727592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" event={"ID":"beab5588-661b-462d-a966-5e604ee38eb2","Type":"ContainerStarted","Data":"ead4a087f35b0f6a66849b3bbd5cad88a4ba80681b37ac243e841e838f618c3c"} Jun 13 01:00:40.733334 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:40.733303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" event={"ID":"fd773d75-25e9-4d63-82c8-1962a7c0fac2","Type":"ContainerStarted","Data":"1c840d807fb2fe00fc551b6d8bd28307aea407b3f85e4195531bc31a4cee0937"} Jun 13 01:00:40.733773 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:40.733366 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" event={"ID":"fd773d75-25e9-4d63-82c8-1962a7c0fac2","Type":"ContainerStarted","Data":"0e4a00aa67adc14dfbe600e7af249426075251ea8b4c70b43d581e9d122052ec"} Jun 13 01:00:40.733773 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:40.733398 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" event={"ID":"fd773d75-25e9-4d63-82c8-1962a7c0fac2","Type":"ContainerStarted","Data":"556b599c67e99c32e4ab0f68dc827b0f5f0967393223b1303e771ca7a43cee9e"} Jun 13 01:00:41.739494 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:41.739397 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" event={"ID":"fd773d75-25e9-4d63-82c8-1962a7c0fac2","Type":"ContainerStarted","Data":"2d61e39f538180f21626388b3f77bd7ef8f8748675d4e612ef668afa532b6271"} Jun 13 01:00:41.739996 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:41.739518 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" event={"ID":"fd773d75-25e9-4d63-82c8-1962a7c0fac2","Type":"ContainerStarted","Data":"7f95ee7bf45e2466de9cb3cebe6ebd8bbf62393268cf76c085cacf085ff734d7"} Jun 13 01:00:41.739996 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:41.739573 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:41.739996 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:41.739612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" event={"ID":"fd773d75-25e9-4d63-82c8-1962a7c0fac2","Type":"ContainerStarted","Data":"8000027bb547138329808563d7e48275aceb240ab540f7b2fa54df2406a27689"} Jun 13 01:00:41.740793 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:41.740770 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" event={"ID":"beab5588-661b-462d-a966-5e604ee38eb2","Type":"ContainerStarted","Data":"cca7a7932fb5fe654c3e7c3d7493bad91248c62d2f06bba97c6ce5ca9d765a52"} Jun 13 01:00:41.761983 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:41.761934 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" podStartSLOduration=2.7547851100000003 podStartE2EDuration="5.761921306s" totalImagesPullingTime="3.007136196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:41.761204046 +0000 UTC m=+271.322698505" watchObservedRunningTime="2026-06-13 01:00:41.761921306 +0000 UTC m=+271.323415764" Jun 13 01:00:42.747041 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:42.747012 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" event={"ID":"beab5588-661b-462d-a966-5e604ee38eb2","Type":"ContainerStarted","Data":"5a38ab698b77e4c11e34d0f6176cd8a604f6a853d635a34221426bcdc4c0cdbf"} Jun 13 01:00:43.752786 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:43.752747 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" event={"ID":"beab5588-661b-462d-a966-5e604ee38eb2","Type":"ContainerStarted","Data":"670664e2f0db0077f40e65ed190556a4734bcf85e85b7534bf782d6e05246556"} Jun 13 01:00:43.776703 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:43.776642 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74488b9889-lvx7z" podStartSLOduration=2.330179191 podStartE2EDuration="5.77662173s" totalImagesPullingTime="3.446442539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:43.774945048 +0000 UTC m=+273.336439506" watchObservedRunningTime="2026-06-13 01:00:43.77662173 +0000 UTC m=+273.338116189" Jun 13 01:00:45.448823 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:45.448767 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:45.449243 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:45.448854 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:00:45.450258 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:45.450234 2563 patch_prober.go:28] interesting pod/console-6cf6bb455f-lcdck container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 13 01:00:45.450351 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:45.450283 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cf6bb455f-lcdck" podUID="12035b4c-70d7-4e13-92a5-ee25dc686885" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 13 01:00:47.752903 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:47.752873 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58766b9554-dcgp6" Jun 13 01:00:48.418948 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:48.418914 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" podUID="9aa740eb-1e54-4869-886e-03cd68f43fbf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 01:00:48.419118 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:48.418976 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" Jun 13 01:00:48.419445 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:48.419418 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4b2c960280e96750a26027168148d4d547710c0673bfd48bc00fe6bc11fdf503"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 13 01:00:48.419487 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:48.419475 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" podUID="9aa740eb-1e54-4869-886e-03cd68f43fbf" containerName="service-proxy" containerID="cri-o://4b2c960280e96750a26027168148d4d547710c0673bfd48bc00fe6bc11fdf503" gracePeriod=30 Jun 13 01:00:48.772298 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:48.772217 2563 generic.go:356] "Generic (PLEG): container finished" podID="9aa740eb-1e54-4869-886e-03cd68f43fbf" containerID="4b2c960280e96750a26027168148d4d547710c0673bfd48bc00fe6bc11fdf503" exitCode=2 Jun 13 01:00:48.772298 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:48.772257 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" event={"ID":"9aa740eb-1e54-4869-886e-03cd68f43fbf","Type":"ContainerDied","Data":"4b2c960280e96750a26027168148d4d547710c0673bfd48bc00fe6bc11fdf503"} Jun 13 01:00:48.772298 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:48.772287 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b9db955bb-52mcc" event={"ID":"9aa740eb-1e54-4869-886e-03cd68f43fbf","Type":"ContainerStarted","Data":"83ce172f22d416d4e7d5a2c034a01433131747c25ed990c2b044b59e19533798"} Jun 13 01:00:51.377657 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:00:51.377613 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-scrkc" podUID="0dbf9ed9-980c-4b0e-8741-095d948b68ce" Jun 13 01:00:51.781467 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:51.781437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-scrkc" Jun 13 01:00:55.305638 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:55.305598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 01:00:55.308180 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:55.308157 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0dbf9ed9-980c-4b0e-8741-095d948b68ce-metrics-tls\") pod \"dns-default-scrkc\" (UID: \"0dbf9ed9-980c-4b0e-8741-095d948b68ce\") " pod="openshift-dns/dns-default-scrkc" Jun 13 01:00:55.384045 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:55.384012 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7d8x8\"" Jun 13 01:00:55.392712 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:55.392683 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-scrkc" Jun 13 01:00:55.448847 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:55.448813 2563 patch_prober.go:28] interesting pod/console-6cf6bb455f-lcdck container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 13 01:00:55.448981 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:55.448877 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cf6bb455f-lcdck" podUID="12035b4c-70d7-4e13-92a5-ee25dc686885" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 13 01:00:55.529849 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:55.529806 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-scrkc"] Jun 13 01:00:55.533713 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:00:55.533680 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbf9ed9_980c_4b0e_8741_095d948b68ce.slice/crio-00321df7be7811b99a65404528e75274fcd407fbebd754b076ad840ee723ca8d WatchSource:0}: Error finding container 00321df7be7811b99a65404528e75274fcd407fbebd754b076ad840ee723ca8d: Status 404 returned error can't find the container with id 00321df7be7811b99a65404528e75274fcd407fbebd754b076ad840ee723ca8d Jun 13 01:00:55.796442 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:55.796404 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-scrkc" event={"ID":"0dbf9ed9-980c-4b0e-8741-095d948b68ce","Type":"ContainerStarted","Data":"00321df7be7811b99a65404528e75274fcd407fbebd754b076ad840ee723ca8d"} Jun 13 01:00:58.811443 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:58.811406 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-scrkc" event={"ID":"0dbf9ed9-980c-4b0e-8741-095d948b68ce","Type":"ContainerStarted","Data":"1a2ca130d1d13004f1e3ee60548f924ab0a099e22956d0364395f3dba1814339"} Jun 13 01:00:58.811967 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:58.811493 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-scrkc" event={"ID":"0dbf9ed9-980c-4b0e-8741-095d948b68ce","Type":"ContainerStarted","Data":"64d44b284d87fcec3e51863f61002d04110d74e8cb89d28485e86d8af674abc4"} Jun 13 01:00:58.811967 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:58.811538 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-scrkc" Jun 13 01:00:58.828035 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:00:58.827988 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-scrkc" podStartSLOduration=251.652666115 podStartE2EDuration="4m13.827973465s" totalImagesPullingTime="2.17530735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:58.827254677 +0000 UTC m=+288.388749133" watchObservedRunningTime="2026-06-13 01:00:58.827973465 +0000 UTC m=+288.389467920" Jun 13 01:01:05.119984 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:05.119946 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf6bb455f-lcdck"] Jun 13 01:01:08.818110 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:08.818080 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-scrkc" Jun 13 01:01:10.792874 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:10.792846 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:01:10.793306 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:10.793286 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:01:10.795862 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:10.795844 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 01:01:14.601347 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:14.601317 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-scrkc_0dbf9ed9-980c-4b0e-8741-095d948b68ce/dns/0.log" Jun 13 01:01:14.606814 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:14.606788 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-scrkc_0dbf9ed9-980c-4b0e-8741-095d948b68ce/kube-rbac-proxy/0.log" Jun 13 01:01:14.693779 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:14.693733 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-84mtz_78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65/dns-node-resolver/0.log" Jun 13 01:01:30.139200 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.139155 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cf6bb455f-lcdck" podUID="12035b4c-70d7-4e13-92a5-ee25dc686885" containerName="console" containerID="cri-o://d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad" gracePeriod=15 Jun 13 01:01:30.378938 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.378914 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:01:30.479568 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.479484 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpnj8\" (UniqueName: \"kubernetes.io/projected/12035b4c-70d7-4e13-92a5-ee25dc686885-kube-api-access-dpnj8\") pod \"12035b4c-70d7-4e13-92a5-ee25dc686885\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " Jun 13 01:01:30.479568 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.479531 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-console-config\") pod \"12035b4c-70d7-4e13-92a5-ee25dc686885\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " Jun 13 01:01:30.479568 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.479561 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-serving-cert\") pod \"12035b4c-70d7-4e13-92a5-ee25dc686885\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " Jun 13 01:01:30.479865 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.479586 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-oauth-serving-cert\") pod \"12035b4c-70d7-4e13-92a5-ee25dc686885\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " Jun 13 01:01:30.479865 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.479607 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-oauth-config\") pod \"12035b4c-70d7-4e13-92a5-ee25dc686885\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " Jun 13 01:01:30.479865 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.479629 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-service-ca\") pod \"12035b4c-70d7-4e13-92a5-ee25dc686885\" (UID: \"12035b4c-70d7-4e13-92a5-ee25dc686885\") " Jun 13 01:01:30.480061 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.480027 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-console-config" (OuterVolumeSpecName: "console-config") pod "12035b4c-70d7-4e13-92a5-ee25dc686885" (UID: "12035b4c-70d7-4e13-92a5-ee25dc686885"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:01:30.480116 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.480056 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12035b4c-70d7-4e13-92a5-ee25dc686885" (UID: "12035b4c-70d7-4e13-92a5-ee25dc686885"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:01:30.480116 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.480097 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-service-ca" (OuterVolumeSpecName: "service-ca") pod "12035b4c-70d7-4e13-92a5-ee25dc686885" (UID: "12035b4c-70d7-4e13-92a5-ee25dc686885"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:01:30.481857 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.481824 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12035b4c-70d7-4e13-92a5-ee25dc686885" (UID: "12035b4c-70d7-4e13-92a5-ee25dc686885"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:01:30.482096 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.482072 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12035b4c-70d7-4e13-92a5-ee25dc686885-kube-api-access-dpnj8" (OuterVolumeSpecName: "kube-api-access-dpnj8") pod "12035b4c-70d7-4e13-92a5-ee25dc686885" (UID: "12035b4c-70d7-4e13-92a5-ee25dc686885"). InnerVolumeSpecName "kube-api-access-dpnj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:01:30.482161 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.482111 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12035b4c-70d7-4e13-92a5-ee25dc686885" (UID: "12035b4c-70d7-4e13-92a5-ee25dc686885"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:01:30.580646 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.580606 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-service-ca\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:01:30.580646 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.580637 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpnj8\" (UniqueName: \"kubernetes.io/projected/12035b4c-70d7-4e13-92a5-ee25dc686885-kube-api-access-dpnj8\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:01:30.580646 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.580650 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-console-config\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:01:30.580901 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.580662 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-serving-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:01:30.580901 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.580674 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12035b4c-70d7-4e13-92a5-ee25dc686885-oauth-serving-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:01:30.580901 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.580684 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12035b4c-70d7-4e13-92a5-ee25dc686885-console-oauth-config\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:01:30.925035 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.925003 2563 generic.go:356] "Generic (PLEG): container finished" podID="12035b4c-70d7-4e13-92a5-ee25dc686885" containerID="d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad" exitCode=0 Jun 13 01:01:30.925206 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.925046 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf6bb455f-lcdck" Jun 13 01:01:30.925206 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.925066 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf6bb455f-lcdck" event={"ID":"12035b4c-70d7-4e13-92a5-ee25dc686885","Type":"ContainerDied","Data":"d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad"} Jun 13 01:01:30.925206 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.925103 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf6bb455f-lcdck" event={"ID":"12035b4c-70d7-4e13-92a5-ee25dc686885","Type":"ContainerDied","Data":"3abc72e894231ca32b8d2ac9491d14cd2497bedd9b40e056b9f9779ccd292ef0"} Jun 13 01:01:30.925206 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.925122 2563 scope.go:117] "RemoveContainer" containerID="d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad" Jun 13 01:01:30.932921 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.932895 2563 scope.go:117] "RemoveContainer" containerID="d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad" Jun 13 01:01:30.933172 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:01:30.933152 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad\": container with ID starting with d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad not found: ID does not exist" containerID="d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad" Jun 13 01:01:30.933228 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.933179 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad"} err="failed to get container status \"d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad\": rpc error: code = NotFound desc = could not find container \"d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad\": container with ID starting with d35af169ab4b49c3c11e20cd9fd7f18e6233f7a545082818809493ff9a62e1ad not found: ID does not exist" Jun 13 01:01:30.938389 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.938370 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf6bb455f-lcdck"] Jun 13 01:01:30.942133 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:30.942112 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cf6bb455f-lcdck"] Jun 13 01:01:32.841651 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:32.841605 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12035b4c-70d7-4e13-92a5-ee25dc686885" path="/var/lib/kubelet/pods/12035b4c-70d7-4e13-92a5-ee25dc686885/volumes" Jun 13 01:01:55.436872 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.436790 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:01:55.437232 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.437056 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12035b4c-70d7-4e13-92a5-ee25dc686885" containerName="console" Jun 13 01:01:55.437232 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.437068 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="12035b4c-70d7-4e13-92a5-ee25dc686885" containerName="console" Jun 13 01:01:55.437232 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.437122 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="12035b4c-70d7-4e13-92a5-ee25dc686885" containerName="console" Jun 13 01:01:55.441677 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.441647 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.444174 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.444148 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 01:01:55.444336 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.444148 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 01:01:55.444336 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.444237 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 01:01:55.444659 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.444637 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 01:01:55.444756 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.444717 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 01:01:55.444864 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.444847 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kbjkr\"" Jun 13 01:01:55.444927 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.444912 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 01:01:55.445129 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.445112 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 01:01:55.445359 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.445340 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 01:01:55.449590 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.449557 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 01:01:55.454586 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.454560 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:01:55.463025 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54bae261-8e26-4134-8011-99116d497c06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463120 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54bae261-8e26-4134-8011-99116d497c06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463120 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54bae261-8e26-4134-8011-99116d497c06-config-out\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463120 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-web-config\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463120 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463250 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463250 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463250 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54bae261-8e26-4134-8011-99116d497c06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463250 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54bae261-8e26-4134-8011-99116d497c06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463370 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-config-volume\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463370 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463370 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.463370 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.463333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69zgj\" (UniqueName: \"kubernetes.io/projected/54bae261-8e26-4134-8011-99116d497c06-kube-api-access-69zgj\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.564007 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.563973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54bae261-8e26-4134-8011-99116d497c06-config-out\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.564007 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.564007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-web-config\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.564223 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.564024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.564223 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.564060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.564223 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.564126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.564223 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.564154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54bae261-8e26-4134-8011-99116d497c06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.564223 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.564176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54bae261-8e26-4134-8011-99116d497c06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.564448 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.564238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-config-volume\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.565305 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.565272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54bae261-8e26-4134-8011-99116d497c06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.565547 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.565526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.565669 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.565652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.565806 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.565790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69zgj\" (UniqueName: \"kubernetes.io/projected/54bae261-8e26-4134-8011-99116d497c06-kube-api-access-69zgj\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.565966 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.565951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54bae261-8e26-4134-8011-99116d497c06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.566080 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.566066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54bae261-8e26-4134-8011-99116d497c06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.566471 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.566448 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54bae261-8e26-4134-8011-99116d497c06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.566927 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.566901 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54bae261-8e26-4134-8011-99116d497c06-config-out\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.567389 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.567165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.567389 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.567178 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.567389 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.567349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.567389 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.567366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54bae261-8e26-4134-8011-99116d497c06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.567615 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.567594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-config-volume\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.567693 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.567673 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-web-config\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.567873 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.567852 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54bae261-8e26-4134-8011-99116d497c06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.568662 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.568642 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.569146 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.569124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54bae261-8e26-4134-8011-99116d497c06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.576584 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.576561 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69zgj\" (UniqueName: \"kubernetes.io/projected/54bae261-8e26-4134-8011-99116d497c06-kube-api-access-69zgj\") pod \"alertmanager-main-0\" (UID: \"54bae261-8e26-4134-8011-99116d497c06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.752426 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.752312 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:01:55.885238 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:55.885204 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:01:55.888439 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:01:55.888410 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54bae261_8e26_4134_8011_99116d497c06.slice/crio-1e9a6329380a05cfa331ed1f6b6c453c6f89eb483d0e6d1d9632559dd34932c6 WatchSource:0}: Error finding container 1e9a6329380a05cfa331ed1f6b6c453c6f89eb483d0e6d1d9632559dd34932c6: Status 404 returned error can't find the container with id 1e9a6329380a05cfa331ed1f6b6c453c6f89eb483d0e6d1d9632559dd34932c6 Jun 13 01:01:56.011411 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:56.011332 2563 generic.go:356] "Generic (PLEG): container finished" podID="54bae261-8e26-4134-8011-99116d497c06" containerID="a75b6057d0458954d185406a509e91a4bbe1da4e030a86282cfec71460862cf0" exitCode=0 Jun 13 01:01:56.011411 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:56.011371 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bae261-8e26-4134-8011-99116d497c06","Type":"ContainerDied","Data":"a75b6057d0458954d185406a509e91a4bbe1da4e030a86282cfec71460862cf0"} Jun 13 01:01:56.011575 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:56.011421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bae261-8e26-4134-8011-99116d497c06","Type":"ContainerStarted","Data":"1e9a6329380a05cfa331ed1f6b6c453c6f89eb483d0e6d1d9632559dd34932c6"} Jun 13 01:01:56.012475 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:56.012458 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:01:58.023222 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:58.023186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bae261-8e26-4134-8011-99116d497c06","Type":"ContainerStarted","Data":"d314652aebe623972330bcde53573018d14bd8be191bdd4756cea87623e8d3d1"} Jun 13 01:01:58.023593 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:58.023284 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bae261-8e26-4134-8011-99116d497c06","Type":"ContainerStarted","Data":"7a195e38a789db211598c3d952d5a0d67edb3ddb58a53c983eebac48a87cd9fb"} Jun 13 01:01:58.023593 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:58.023311 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bae261-8e26-4134-8011-99116d497c06","Type":"ContainerStarted","Data":"e706d6bec49f18ea2225feda0c902fb219427e25df8f1a6166d71cb5fe76c0b9"} Jun 13 01:01:58.023593 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:58.023335 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bae261-8e26-4134-8011-99116d497c06","Type":"ContainerStarted","Data":"51a319f42f3363ce30e244331da62d74ca771e371981ab0b094bc352a0cdc53f"} Jun 13 01:01:58.023593 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:58.023367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bae261-8e26-4134-8011-99116d497c06","Type":"ContainerStarted","Data":"006ce6f7a8440bb86f6c6694c59cd168a5dec7ba5b28bb4bb6fefb63d6b49e59"} Jun 13 01:01:58.023593 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:58.023390 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bae261-8e26-4134-8011-99116d497c06","Type":"ContainerStarted","Data":"9f3cb678ae5ea588e900c3ba7a91d37e19f4771982b82ede67beba4d35f43fc4"} Jun 13 01:01:58.048315 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:01:58.048266 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.453242884 podStartE2EDuration="3.048250588s" totalImagesPullingTime="1.579964472s" totalInitContainerRuntime="15.043232ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:01:58.04778639 +0000 UTC m=+347.609280848" watchObservedRunningTime="2026-06-13 01:01:58.048250588 +0000 UTC m=+347.609745047" Jun 13 01:03:52.421485 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.421391 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nqfds"] Jun 13 01:03:52.424546 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.424530 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:03:52.426648 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.426626 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 01:03:52.426937 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.426919 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gxpmd\"" Jun 13 01:03:52.427207 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.427190 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 01:03:52.434814 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.434794 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nqfds"] Jun 13 01:03:52.554426 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.554389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn7ql\" (UniqueName: \"kubernetes.io/projected/a49108c3-9308-4223-9233-107334555ef5-kube-api-access-rn7ql\") pod \"cert-manager-webhook-7dc76cbb94-nqfds\" (UID: \"a49108c3-9308-4223-9233-107334555ef5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:03:52.554609 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.554449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49108c3-9308-4223-9233-107334555ef5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nqfds\" (UID: \"a49108c3-9308-4223-9233-107334555ef5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:03:52.655759 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.655687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49108c3-9308-4223-9233-107334555ef5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nqfds\" (UID: \"a49108c3-9308-4223-9233-107334555ef5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:03:52.655923 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.655793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7ql\" (UniqueName: \"kubernetes.io/projected/a49108c3-9308-4223-9233-107334555ef5-kube-api-access-rn7ql\") pod \"cert-manager-webhook-7dc76cbb94-nqfds\" (UID: \"a49108c3-9308-4223-9233-107334555ef5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:03:52.663576 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.663539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn7ql\" (UniqueName: \"kubernetes.io/projected/a49108c3-9308-4223-9233-107334555ef5-kube-api-access-rn7ql\") pod \"cert-manager-webhook-7dc76cbb94-nqfds\" (UID: \"a49108c3-9308-4223-9233-107334555ef5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:03:52.663700 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.663642 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a49108c3-9308-4223-9233-107334555ef5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nqfds\" (UID: \"a49108c3-9308-4223-9233-107334555ef5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:03:52.733196 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.733106 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:03:52.861565 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:52.861531 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nqfds"] Jun 13 01:03:52.864850 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:03:52.864820 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda49108c3_9308_4223_9233_107334555ef5.slice/crio-88e6e1bae61bb468a2b80bc745dfe97b2824e9bc720942d859da1f18eef1a310 WatchSource:0}: Error finding container 88e6e1bae61bb468a2b80bc745dfe97b2824e9bc720942d859da1f18eef1a310: Status 404 returned error can't find the container with id 88e6e1bae61bb468a2b80bc745dfe97b2824e9bc720942d859da1f18eef1a310 Jun 13 01:03:53.446859 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:53.446828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" event={"ID":"a49108c3-9308-4223-9233-107334555ef5","Type":"ContainerStarted","Data":"88e6e1bae61bb468a2b80bc745dfe97b2824e9bc720942d859da1f18eef1a310"} Jun 13 01:03:56.462079 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:56.462040 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" event={"ID":"a49108c3-9308-4223-9233-107334555ef5","Type":"ContainerStarted","Data":"14ca825970e7692682a9ec6ae1a25d05696458779bfe04996c85b6f1831d2e20"} Jun 13 01:03:56.462544 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:56.462155 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:03:56.479302 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:03:56.479249 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" podStartSLOduration=1.526881308 podStartE2EDuration="4.479232387s" totalImagesPullingTime="2.952351079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:03:56.478123561 +0000 UTC m=+466.039618020" watchObservedRunningTime="2026-06-13 01:03:56.479232387 +0000 UTC m=+466.040726844" Jun 13 01:04:02.468443 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:02.468413 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nqfds" Jun 13 01:04:18.965208 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:18.965169 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7"] Jun 13 01:04:18.968563 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:18.968541 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:18.970968 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:18.970945 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:04:18.971132 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:18.970987 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 13 01:04:18.971206 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:18.971022 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pjwnh\"" Jun 13 01:04:18.971206 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:18.971039 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 13 01:04:18.971307 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:18.971046 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 13 01:04:18.971307 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:18.971069 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 01:04:18.978826 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:18.978803 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7"] Jun 13 01:04:19.060118 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.060067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c004ea14-7856-4e69-bef8-a7df9d5594d3-metrics-cert\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.060310 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.060169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c004ea14-7856-4e69-bef8-a7df9d5594d3-manager-config\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.060310 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.060210 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7tl9\" (UniqueName: \"kubernetes.io/projected/c004ea14-7856-4e69-bef8-a7df9d5594d3-kube-api-access-z7tl9\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.060310 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.060235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c004ea14-7856-4e69-bef8-a7df9d5594d3-cert\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.160693 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.160662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c004ea14-7856-4e69-bef8-a7df9d5594d3-metrics-cert\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.160834 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.160709 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c004ea14-7856-4e69-bef8-a7df9d5594d3-manager-config\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.160887 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.160853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7tl9\" (UniqueName: \"kubernetes.io/projected/c004ea14-7856-4e69-bef8-a7df9d5594d3-kube-api-access-z7tl9\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.160922 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.160890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c004ea14-7856-4e69-bef8-a7df9d5594d3-cert\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.161329 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.161309 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c004ea14-7856-4e69-bef8-a7df9d5594d3-manager-config\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.163277 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.163255 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c004ea14-7856-4e69-bef8-a7df9d5594d3-metrics-cert\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.163367 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.163335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c004ea14-7856-4e69-bef8-a7df9d5594d3-cert\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.172856 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.172835 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7tl9\" (UniqueName: \"kubernetes.io/projected/c004ea14-7856-4e69-bef8-a7df9d5594d3-kube-api-access-z7tl9\") pod \"lws-controller-manager-6dc4584f75-gqct7\" (UID: \"c004ea14-7856-4e69-bef8-a7df9d5594d3\") " pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.278398 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.278301 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:19.411218 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.411179 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7"] Jun 13 01:04:19.414020 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:04:19.413990 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc004ea14_7856_4e69_bef8_a7df9d5594d3.slice/crio-5f623d9fc7b3c7596f4ee0f29de3b4ceceeb1efde2c436d8e739a5b8390bf0c0 WatchSource:0}: Error finding container 5f623d9fc7b3c7596f4ee0f29de3b4ceceeb1efde2c436d8e739a5b8390bf0c0: Status 404 returned error can't find the container with id 5f623d9fc7b3c7596f4ee0f29de3b4ceceeb1efde2c436d8e739a5b8390bf0c0 Jun 13 01:04:19.546228 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:19.546188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" event={"ID":"c004ea14-7856-4e69-bef8-a7df9d5594d3","Type":"ContainerStarted","Data":"5f623d9fc7b3c7596f4ee0f29de3b4ceceeb1efde2c436d8e739a5b8390bf0c0"} Jun 13 01:04:22.559617 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:22.559579 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" event={"ID":"c004ea14-7856-4e69-bef8-a7df9d5594d3","Type":"ContainerStarted","Data":"869c893daf82745854de0b81e3bbff55e074562765504086ed4e7622b25b249c"} Jun 13 01:04:22.560053 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:22.559699 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:22.581941 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:22.581888 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" podStartSLOduration=2.405556653 podStartE2EDuration="4.581870761s" totalImagesPullingTime="2.176314108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:22.58083825 +0000 UTC m=+492.142332715" watchObservedRunningTime="2026-06-13 01:04:22.581870761 +0000 UTC m=+492.143365219" Jun 13 01:04:24.194363 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.194324 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd"] Jun 13 01:04:24.197775 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.197729 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.201030 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.201007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 01:04:24.201151 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.201071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7kh2m\"" Jun 13 01:04:24.201151 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.201017 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 01:04:24.201270 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.201157 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 01:04:24.201270 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.201257 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 01:04:24.222468 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.222439 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd"] Jun 13 01:04:24.301025 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.300984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9b811027-978e-4f34-a56a-7e4667278f42-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.301204 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.301038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5q9s\" (UniqueName: \"kubernetes.io/projected/9b811027-978e-4f34-a56a-7e4667278f42-kube-api-access-p5q9s\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.301204 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.301062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9b811027-978e-4f34-a56a-7e4667278f42-manifests\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.301204 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.301120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b811027-978e-4f34-a56a-7e4667278f42-webhook-cert\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.301204 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.301151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b811027-978e-4f34-a56a-7e4667278f42-tmp\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.402451 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.402407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b811027-978e-4f34-a56a-7e4667278f42-webhook-cert\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.402656 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.402467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b811027-978e-4f34-a56a-7e4667278f42-tmp\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.402656 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.402498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9b811027-978e-4f34-a56a-7e4667278f42-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.402656 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.402540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5q9s\" (UniqueName: \"kubernetes.io/projected/9b811027-978e-4f34-a56a-7e4667278f42-kube-api-access-p5q9s\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.402656 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.402568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9b811027-978e-4f34-a56a-7e4667278f42-manifests\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.403032 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.403011 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9b811027-978e-4f34-a56a-7e4667278f42-manifests\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.404786 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.404769 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b811027-978e-4f34-a56a-7e4667278f42-tmp\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.405007 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.404991 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b811027-978e-4f34-a56a-7e4667278f42-webhook-cert\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.405151 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.405130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9b811027-978e-4f34-a56a-7e4667278f42-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.427294 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.427256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5q9s\" (UniqueName: \"kubernetes.io/projected/9b811027-978e-4f34-a56a-7e4667278f42-kube-api-access-p5q9s\") pod \"opendatahub-operator-controller-manager-78dd6f457b-rqgnd\" (UID: \"9b811027-978e-4f34-a56a-7e4667278f42\") " pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.507453 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.507362 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:24.675976 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:24.675940 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd"] Jun 13 01:04:24.679502 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:04:24.679472 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b811027_978e_4f34_a56a_7e4667278f42.slice/crio-b802847917eb2a73bec1b0c9de68c0e03866abfc7198d2fe119f420425df638f WatchSource:0}: Error finding container b802847917eb2a73bec1b0c9de68c0e03866abfc7198d2fe119f420425df638f: Status 404 returned error can't find the container with id b802847917eb2a73bec1b0c9de68c0e03866abfc7198d2fe119f420425df638f Jun 13 01:04:25.573833 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:25.573770 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" event={"ID":"9b811027-978e-4f34-a56a-7e4667278f42","Type":"ContainerStarted","Data":"b802847917eb2a73bec1b0c9de68c0e03866abfc7198d2fe119f420425df638f"} Jun 13 01:04:27.583112 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:27.583078 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" event={"ID":"9b811027-978e-4f34-a56a-7e4667278f42","Type":"ContainerStarted","Data":"38076fdc758f5c530925fc32efd67c1aa4ace5e9d00c66fdb14179860212f9ba"} Jun 13 01:04:28.588388 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:28.588305 2563 generic.go:356] "Generic (PLEG): container finished" podID="9b811027-978e-4f34-a56a-7e4667278f42" containerID="38076fdc758f5c530925fc32efd67c1aa4ace5e9d00c66fdb14179860212f9ba" exitCode=0 Jun 13 01:04:28.588388 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:28.588382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" event={"ID":"9b811027-978e-4f34-a56a-7e4667278f42","Type":"ContainerDied","Data":"38076fdc758f5c530925fc32efd67c1aa4ace5e9d00c66fdb14179860212f9ba"} Jun 13 01:04:29.598029 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:29.597995 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" event={"ID":"9b811027-978e-4f34-a56a-7e4667278f42","Type":"ContainerStarted","Data":"849fc7b3eabadaaba19ae5659d49ffd1fe4e37c10a9d9bc72a047f463694f2e7"} Jun 13 01:04:29.598436 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:29.598108 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:29.628076 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:29.628024 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" podStartSLOduration=1.665288233 podStartE2EDuration="5.628007098s" totalImagesPullingTime="3.046973807s" totalInitContainerRuntime="915.745058ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:29.626144436 +0000 UTC m=+499.187638894" watchObservedRunningTime="2026-06-13 01:04:29.628007098 +0000 UTC m=+499.189501621" Jun 13 01:04:33.565063 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:33.565025 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6dc4584f75-gqct7" Jun 13 01:04:40.603803 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:40.603775 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78dd6f457b-rqgnd" Jun 13 01:04:44.046160 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.046123 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4"] Jun 13 01:04:44.051683 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.051658 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.057014 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.056992 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 01:04:44.057014 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.056991 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 01:04:44.057557 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.057536 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-78clt\"" Jun 13 01:04:44.057684 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.057624 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 01:04:44.057684 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.057624 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 01:04:44.078320 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.078284 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4"] Jun 13 01:04:44.156673 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.156637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6707c457-18d8-469f-85ce-84e2ca53f75e-tmp\") pod \"kube-auth-proxy-5d4c88f8bb-nb9v4\" (UID: \"6707c457-18d8-469f-85ce-84e2ca53f75e\") " pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.156880 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.156699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnfng\" (UniqueName: \"kubernetes.io/projected/6707c457-18d8-469f-85ce-84e2ca53f75e-kube-api-access-hnfng\") pod \"kube-auth-proxy-5d4c88f8bb-nb9v4\" (UID: \"6707c457-18d8-469f-85ce-84e2ca53f75e\") " pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.156880 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.156817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6707c457-18d8-469f-85ce-84e2ca53f75e-tls-certs\") pod \"kube-auth-proxy-5d4c88f8bb-nb9v4\" (UID: \"6707c457-18d8-469f-85ce-84e2ca53f75e\") " pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.257974 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.257930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnfng\" (UniqueName: \"kubernetes.io/projected/6707c457-18d8-469f-85ce-84e2ca53f75e-kube-api-access-hnfng\") pod \"kube-auth-proxy-5d4c88f8bb-nb9v4\" (UID: \"6707c457-18d8-469f-85ce-84e2ca53f75e\") " pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.258157 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.258004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6707c457-18d8-469f-85ce-84e2ca53f75e-tls-certs\") pod \"kube-auth-proxy-5d4c88f8bb-nb9v4\" (UID: \"6707c457-18d8-469f-85ce-84e2ca53f75e\") " pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.258157 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.258025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6707c457-18d8-469f-85ce-84e2ca53f75e-tmp\") pod \"kube-auth-proxy-5d4c88f8bb-nb9v4\" (UID: \"6707c457-18d8-469f-85ce-84e2ca53f75e\") " pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.260261 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.260229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6707c457-18d8-469f-85ce-84e2ca53f75e-tmp\") pod \"kube-auth-proxy-5d4c88f8bb-nb9v4\" (UID: \"6707c457-18d8-469f-85ce-84e2ca53f75e\") " pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.260507 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.260486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6707c457-18d8-469f-85ce-84e2ca53f75e-tls-certs\") pod \"kube-auth-proxy-5d4c88f8bb-nb9v4\" (UID: \"6707c457-18d8-469f-85ce-84e2ca53f75e\") " pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.278730 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.278701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnfng\" (UniqueName: \"kubernetes.io/projected/6707c457-18d8-469f-85ce-84e2ca53f75e-kube-api-access-hnfng\") pod \"kube-auth-proxy-5d4c88f8bb-nb9v4\" (UID: \"6707c457-18d8-469f-85ce-84e2ca53f75e\") " pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.363524 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.363437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" Jun 13 01:04:44.499446 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.499413 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4"] Jun 13 01:04:44.502941 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:04:44.502914 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6707c457_18d8_469f_85ce_84e2ca53f75e.slice/crio-0b2257b75a9011dcac3f78708ca35948b2a5341100cdba8a21d8ffab484ebb46 WatchSource:0}: Error finding container 0b2257b75a9011dcac3f78708ca35948b2a5341100cdba8a21d8ffab484ebb46: Status 404 returned error can't find the container with id 0b2257b75a9011dcac3f78708ca35948b2a5341100cdba8a21d8ffab484ebb46 Jun 13 01:04:44.656638 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:44.656553 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" event={"ID":"6707c457-18d8-469f-85ce-84e2ca53f75e","Type":"ContainerStarted","Data":"0b2257b75a9011dcac3f78708ca35948b2a5341100cdba8a21d8ffab484ebb46"} Jun 13 01:04:47.672158 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:47.672118 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" event={"ID":"6707c457-18d8-469f-85ce-84e2ca53f75e","Type":"ContainerStarted","Data":"57e2d476a406812c9596bc714e2c8829a73b03a9d33108d16cb6fae17e85cfa8"} Jun 13 01:04:47.690132 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:04:47.690082 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d4c88f8bb-nb9v4" podStartSLOduration=1.124067045 podStartE2EDuration="3.690065018s" totalImagesPullingTime="2.565997973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:47.689132691 +0000 UTC m=+517.250627147" watchObservedRunningTime="2026-06-13 01:04:47.690065018 +0000 UTC m=+517.251559477" Jun 13 01:06:10.821010 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:10.820978 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:06:10.821576 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:10.821401 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:06:23.272884 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.272801 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j"] Jun 13 01:06:23.275938 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.275920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.278170 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.278146 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 13 01:06:23.278278 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.278155 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 01:06:23.278278 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.278233 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 13 01:06:23.278452 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.278439 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 01:06:23.279102 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.279087 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-q5vkz\"" Jun 13 01:06:23.292793 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.292771 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j"] Jun 13 01:06:23.385243 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.385199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3883b9-161d-404f-a82c-f946b0de78dd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9gm2j\" (UID: \"8c3883b9-161d-404f-a82c-f946b0de78dd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.385434 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.385257 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj5lf\" (UniqueName: \"kubernetes.io/projected/8c3883b9-161d-404f-a82c-f946b0de78dd-kube-api-access-xj5lf\") pod \"kuadrant-console-plugin-66b5774985-9gm2j\" (UID: \"8c3883b9-161d-404f-a82c-f946b0de78dd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.385434 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.385317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8c3883b9-161d-404f-a82c-f946b0de78dd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9gm2j\" (UID: \"8c3883b9-161d-404f-a82c-f946b0de78dd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.486435 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.486394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3883b9-161d-404f-a82c-f946b0de78dd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9gm2j\" (UID: \"8c3883b9-161d-404f-a82c-f946b0de78dd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.486633 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.486459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5lf\" (UniqueName: \"kubernetes.io/projected/8c3883b9-161d-404f-a82c-f946b0de78dd-kube-api-access-xj5lf\") pod \"kuadrant-console-plugin-66b5774985-9gm2j\" (UID: \"8c3883b9-161d-404f-a82c-f946b0de78dd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.486633 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.486522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8c3883b9-161d-404f-a82c-f946b0de78dd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9gm2j\" (UID: \"8c3883b9-161d-404f-a82c-f946b0de78dd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.487255 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.487231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8c3883b9-161d-404f-a82c-f946b0de78dd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9gm2j\" (UID: \"8c3883b9-161d-404f-a82c-f946b0de78dd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.489042 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.489019 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3883b9-161d-404f-a82c-f946b0de78dd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9gm2j\" (UID: \"8c3883b9-161d-404f-a82c-f946b0de78dd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.499669 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.499645 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj5lf\" (UniqueName: \"kubernetes.io/projected/8c3883b9-161d-404f-a82c-f946b0de78dd-kube-api-access-xj5lf\") pod \"kuadrant-console-plugin-66b5774985-9gm2j\" (UID: \"8c3883b9-161d-404f-a82c-f946b0de78dd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.585252 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.585217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" Jun 13 01:06:23.719950 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:23.719835 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j"] Jun 13 01:06:23.722665 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:06:23.722631 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c3883b9_161d_404f_a82c_f946b0de78dd.slice/crio-a04917b590644cd5a09b894626d9e9444ab69578b450bcefcf042d0271e435c9 WatchSource:0}: Error finding container a04917b590644cd5a09b894626d9e9444ab69578b450bcefcf042d0271e435c9: Status 404 returned error can't find the container with id a04917b590644cd5a09b894626d9e9444ab69578b450bcefcf042d0271e435c9 Jun 13 01:06:24.046598 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:24.046563 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" event={"ID":"8c3883b9-161d-404f-a82c-f946b0de78dd","Type":"ContainerStarted","Data":"a04917b590644cd5a09b894626d9e9444ab69578b450bcefcf042d0271e435c9"} Jun 13 01:06:48.163306 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:48.163270 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" event={"ID":"8c3883b9-161d-404f-a82c-f946b0de78dd","Type":"ContainerStarted","Data":"777022803f7076c09a55473bba6bb3ed438b077eb264233de3f28fddc89351fb"} Jun 13 01:06:48.180826 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:06:48.180771 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gm2j" podStartSLOduration=1.612420991 podStartE2EDuration="25.18072574s" totalImagesPullingTime="23.568304749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:06:48.179146885 +0000 UTC m=+637.740641344" watchObservedRunningTime="2026-06-13 01:06:48.18072574 +0000 UTC m=+637.742220197" Jun 13 01:07:03.561367 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.561334 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:07:03.567631 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.565365 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:07:03.567810 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.567719 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 13 01:07:03.573474 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.573443 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:07:03.611509 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.611472 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:07:03.750641 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.750596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ecb11c42-21cf-4107-a07a-12ed78f30883-config-file\") pod \"limitador-limitador-54d6d988d5-8hdlb\" (UID: \"ecb11c42-21cf-4107-a07a-12ed78f30883\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:07:03.750835 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.750655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txr89\" (UniqueName: \"kubernetes.io/projected/ecb11c42-21cf-4107-a07a-12ed78f30883-kube-api-access-txr89\") pod \"limitador-limitador-54d6d988d5-8hdlb\" (UID: \"ecb11c42-21cf-4107-a07a-12ed78f30883\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:07:03.852090 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.852003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ecb11c42-21cf-4107-a07a-12ed78f30883-config-file\") pod \"limitador-limitador-54d6d988d5-8hdlb\" (UID: \"ecb11c42-21cf-4107-a07a-12ed78f30883\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:07:03.852090 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.852050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txr89\" (UniqueName: \"kubernetes.io/projected/ecb11c42-21cf-4107-a07a-12ed78f30883-kube-api-access-txr89\") pod \"limitador-limitador-54d6d988d5-8hdlb\" (UID: \"ecb11c42-21cf-4107-a07a-12ed78f30883\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:07:03.852667 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.852647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ecb11c42-21cf-4107-a07a-12ed78f30883-config-file\") pod \"limitador-limitador-54d6d988d5-8hdlb\" (UID: \"ecb11c42-21cf-4107-a07a-12ed78f30883\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:07:03.861990 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.861954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txr89\" (UniqueName: \"kubernetes.io/projected/ecb11c42-21cf-4107-a07a-12ed78f30883-kube-api-access-txr89\") pod \"limitador-limitador-54d6d988d5-8hdlb\" (UID: \"ecb11c42-21cf-4107-a07a-12ed78f30883\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:07:03.877816 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:03.877788 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:07:04.007186 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.007152 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:07:04.010284 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:07:04.010254 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb11c42_21cf_4107_a07a_12ed78f30883.slice/crio-77b26afc57b076df2478e1a70411f94e462f66470efb004a5c4e5237ed586b79 WatchSource:0}: Error finding container 77b26afc57b076df2478e1a70411f94e462f66470efb004a5c4e5237ed586b79: Status 404 returned error can't find the container with id 77b26afc57b076df2478e1a70411f94e462f66470efb004a5c4e5237ed586b79 Jun 13 01:07:04.012280 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.012265 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:07:04.229951 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.229869 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" event={"ID":"ecb11c42-21cf-4107-a07a-12ed78f30883","Type":"ContainerStarted","Data":"77b26afc57b076df2478e1a70411f94e462f66470efb004a5c4e5237ed586b79"} Jun 13 01:07:04.332171 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.332135 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-n48cv"] Jun 13 01:07:04.335053 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.335034 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n48cv" Jun 13 01:07:04.338244 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.338220 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b7jx6\"" Jun 13 01:07:04.357872 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.357823 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-n48cv"] Jun 13 01:07:04.457797 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.457756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clwg2\" (UniqueName: \"kubernetes.io/projected/a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa-kube-api-access-clwg2\") pod \"authorino-58cd955675-n48cv\" (UID: \"a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa\") " pod="kuadrant-system/authorino-58cd955675-n48cv" Jun 13 01:07:04.558703 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.558666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clwg2\" (UniqueName: \"kubernetes.io/projected/a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa-kube-api-access-clwg2\") pod \"authorino-58cd955675-n48cv\" (UID: \"a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa\") " pod="kuadrant-system/authorino-58cd955675-n48cv" Jun 13 01:07:04.569979 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.569946 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clwg2\" (UniqueName: \"kubernetes.io/projected/a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa-kube-api-access-clwg2\") pod \"authorino-58cd955675-n48cv\" (UID: \"a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa\") " pod="kuadrant-system/authorino-58cd955675-n48cv" Jun 13 01:07:04.644644 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.644606 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n48cv" Jun 13 01:07:04.812057 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:04.811908 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-n48cv"] Jun 13 01:07:04.814913 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:07:04.814881 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda48ef6a6_76f2_4dbd_bdbf_a79db87fc1aa.slice/crio-fe84e2a2f6b04e614f86da916fb465d1ed54921d80c7a2814b0f3a6ff7fa6042 WatchSource:0}: Error finding container fe84e2a2f6b04e614f86da916fb465d1ed54921d80c7a2814b0f3a6ff7fa6042: Status 404 returned error can't find the container with id fe84e2a2f6b04e614f86da916fb465d1ed54921d80c7a2814b0f3a6ff7fa6042 Jun 13 01:07:05.237660 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:05.237568 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n48cv" event={"ID":"a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa","Type":"ContainerStarted","Data":"fe84e2a2f6b04e614f86da916fb465d1ed54921d80c7a2814b0f3a6ff7fa6042"} Jun 13 01:07:07.250081 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:07.250038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" event={"ID":"ecb11c42-21cf-4107-a07a-12ed78f30883","Type":"ContainerStarted","Data":"9769d7ad004998b579df9751d20df3a16db6ce00b12529a5f0694a29f70af3f0"} Jun 13 01:07:07.250537 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:07.250180 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:07:07.268755 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:07.268682 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" podStartSLOduration=1.711268214 podStartE2EDuration="4.268658771s" totalImagesPullingTime="2.557390557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:07:07.266603485 +0000 UTC m=+656.828097944" watchObservedRunningTime="2026-06-13 01:07:07.268658771 +0000 UTC m=+656.830153228" Jun 13 01:07:08.533329 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:08.533293 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-n48cv"] Jun 13 01:07:09.262077 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:09.262039 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n48cv" event={"ID":"a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa","Type":"ContainerStarted","Data":"20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0"} Jun 13 01:07:09.262232 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:09.262154 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-n48cv" podUID="a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa" containerName="authorino" containerID="cri-o://20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0" gracePeriod=30 Jun 13 01:07:09.276113 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:09.276055 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-n48cv" podStartSLOduration=1.486493716 podStartE2EDuration="5.276035141s" totalImagesPullingTime="3.789541425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:07:09.274264569 +0000 UTC m=+658.835759028" watchObservedRunningTime="2026-06-13 01:07:09.276035141 +0000 UTC m=+658.837529625" Jun 13 01:07:09.498198 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:09.498169 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n48cv" Jun 13 01:07:09.499324 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:09.499304 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clwg2\" (UniqueName: \"kubernetes.io/projected/a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa-kube-api-access-clwg2\") pod \"a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa\" (UID: \"a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa\") " Jun 13 01:07:09.501385 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:09.501357 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa-kube-api-access-clwg2" (OuterVolumeSpecName: "kube-api-access-clwg2") pod "a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa" (UID: "a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa"). InnerVolumeSpecName "kube-api-access-clwg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:07:09.600524 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:09.600481 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clwg2\" (UniqueName: \"kubernetes.io/projected/a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa-kube-api-access-clwg2\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:07:10.268780 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.268722 2563 generic.go:356] "Generic (PLEG): container finished" podID="a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa" containerID="20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0" exitCode=0 Jun 13 01:07:10.268780 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.268772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n48cv" event={"ID":"a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa","Type":"ContainerDied","Data":"20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0"} Jun 13 01:07:10.268993 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.268796 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n48cv" Jun 13 01:07:10.268993 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.268819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n48cv" event={"ID":"a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa","Type":"ContainerDied","Data":"fe84e2a2f6b04e614f86da916fb465d1ed54921d80c7a2814b0f3a6ff7fa6042"} Jun 13 01:07:10.268993 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.268841 2563 scope.go:117] "RemoveContainer" containerID="20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0" Jun 13 01:07:10.277326 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.277305 2563 scope.go:117] "RemoveContainer" containerID="20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0" Jun 13 01:07:10.277591 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:07:10.277573 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0\": container with ID starting with 20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0 not found: ID does not exist" containerID="20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0" Jun 13 01:07:10.277681 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.277598 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0"} err="failed to get container status \"20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0\": rpc error: code = NotFound desc = could not find container \"20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0\": container with ID starting with 20a241ccfc26f5d9664cc308970927affb1ed109a1d0afc1062aeb2c9b3b88b0 not found: ID does not exist" Jun 13 01:07:10.288695 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.288670 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-n48cv"] Jun 13 01:07:10.296590 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.296564 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-n48cv"] Jun 13 01:07:10.842816 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:10.842789 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa" path="/var/lib/kubelet/pods/a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa/volumes" Jun 13 01:07:18.256374 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:07:18.256337 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8hdlb" Jun 13 01:08:34.476038 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.476000 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6849dc9c68-w9r82"] Jun 13 01:08:34.476504 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.476347 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa" containerName="authorino" Jun 13 01:08:34.476504 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.476360 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa" containerName="authorino" Jun 13 01:08:34.476504 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.476424 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a48ef6a6-76f2-4dbd-bdbf-a79db87fc1aa" containerName="authorino" Jun 13 01:08:34.479665 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.479637 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:34.481803 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.481770 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 13 01:08:34.481925 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.481876 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-stqd6\"" Jun 13 01:08:34.482108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.482095 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 13 01:08:34.487226 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.487184 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6849dc9c68-w9r82"] Jun 13 01:08:34.609809 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.609773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39093b56-614f-4b58-b9ed-8a298e7a71ed-webhook-cert\") pod \"maas-controller-6849dc9c68-w9r82\" (UID: \"39093b56-614f-4b58-b9ed-8a298e7a71ed\") " pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:34.609991 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.609879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sps6g\" (UniqueName: \"kubernetes.io/projected/39093b56-614f-4b58-b9ed-8a298e7a71ed-kube-api-access-sps6g\") pod \"maas-controller-6849dc9c68-w9r82\" (UID: \"39093b56-614f-4b58-b9ed-8a298e7a71ed\") " pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:34.647508 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.647473 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b6b769cc9-8fqld"] Jun 13 01:08:34.650943 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.650920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:34.658251 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.658224 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6b769cc9-8fqld"] Jun 13 01:08:34.711195 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.711157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39093b56-614f-4b58-b9ed-8a298e7a71ed-webhook-cert\") pod \"maas-controller-6849dc9c68-w9r82\" (UID: \"39093b56-614f-4b58-b9ed-8a298e7a71ed\") " pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:34.711365 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.711244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sps6g\" (UniqueName: \"kubernetes.io/projected/39093b56-614f-4b58-b9ed-8a298e7a71ed-kube-api-access-sps6g\") pod \"maas-controller-6849dc9c68-w9r82\" (UID: \"39093b56-614f-4b58-b9ed-8a298e7a71ed\") " pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:34.711365 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:08:34.711301 2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 13 01:08:34.711437 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:08:34.711386 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39093b56-614f-4b58-b9ed-8a298e7a71ed-webhook-cert podName:39093b56-614f-4b58-b9ed-8a298e7a71ed nodeName:}" failed. No retries permitted until 2026-06-13 01:08:35.211370255 +0000 UTC m=+744.772864691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/39093b56-614f-4b58-b9ed-8a298e7a71ed-webhook-cert") pod "maas-controller-6849dc9c68-w9r82" (UID: "39093b56-614f-4b58-b9ed-8a298e7a71ed") : secret "maas-controller-webhook-cert" not found Jun 13 01:08:34.721348 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.721322 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sps6g\" (UniqueName: \"kubernetes.io/projected/39093b56-614f-4b58-b9ed-8a298e7a71ed-kube-api-access-sps6g\") pod \"maas-controller-6849dc9c68-w9r82\" (UID: \"39093b56-614f-4b58-b9ed-8a298e7a71ed\") " pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:34.812195 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.812154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-webhook-cert\") pod \"maas-controller-6b6b769cc9-8fqld\" (UID: \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\") " pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:34.812195 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.812188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvpmj\" (UniqueName: \"kubernetes.io/projected/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-kube-api-access-dvpmj\") pod \"maas-controller-6b6b769cc9-8fqld\" (UID: \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\") " pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:34.913655 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.913615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-webhook-cert\") pod \"maas-controller-6b6b769cc9-8fqld\" (UID: \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\") " pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:34.913655 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.913656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvpmj\" (UniqueName: \"kubernetes.io/projected/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-kube-api-access-dvpmj\") pod \"maas-controller-6b6b769cc9-8fqld\" (UID: \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\") " pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:34.916122 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.916091 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-webhook-cert\") pod \"maas-controller-6b6b769cc9-8fqld\" (UID: \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\") " pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:34.921073 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.921050 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvpmj\" (UniqueName: \"kubernetes.io/projected/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-kube-api-access-dvpmj\") pod \"maas-controller-6b6b769cc9-8fqld\" (UID: \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\") " pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:34.961689 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:34.961643 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:35.096909 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:35.096881 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6b769cc9-8fqld"] Jun 13 01:08:35.099202 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:08:35.099172 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadfbbf21_fc21_4ba4_9088_fd6cfd08f40e.slice/crio-a20d2ca65c79efc7a74e96fc75392a82ca18654e6d23c1839666749ec084bdad WatchSource:0}: Error finding container a20d2ca65c79efc7a74e96fc75392a82ca18654e6d23c1839666749ec084bdad: Status 404 returned error can't find the container with id a20d2ca65c79efc7a74e96fc75392a82ca18654e6d23c1839666749ec084bdad Jun 13 01:08:35.216540 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:35.216496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39093b56-614f-4b58-b9ed-8a298e7a71ed-webhook-cert\") pod \"maas-controller-6849dc9c68-w9r82\" (UID: \"39093b56-614f-4b58-b9ed-8a298e7a71ed\") " pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:35.218971 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:35.218946 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39093b56-614f-4b58-b9ed-8a298e7a71ed-webhook-cert\") pod \"maas-controller-6849dc9c68-w9r82\" (UID: \"39093b56-614f-4b58-b9ed-8a298e7a71ed\") " pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:35.391945 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:35.391855 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:35.522486 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:35.522461 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6849dc9c68-w9r82"] Jun 13 01:08:35.524552 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:08:35.524525 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39093b56_614f_4b58_b9ed_8a298e7a71ed.slice/crio-77dae1607e66f2b66dedba5509d366889fb0c4aaba8e51ac249bfde37dd6e802 WatchSource:0}: Error finding container 77dae1607e66f2b66dedba5509d366889fb0c4aaba8e51ac249bfde37dd6e802: Status 404 returned error can't find the container with id 77dae1607e66f2b66dedba5509d366889fb0c4aaba8e51ac249bfde37dd6e802 Jun 13 01:08:35.634529 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:35.634491 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" event={"ID":"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e","Type":"ContainerStarted","Data":"a20d2ca65c79efc7a74e96fc75392a82ca18654e6d23c1839666749ec084bdad"} Jun 13 01:08:35.635645 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:35.635622 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6849dc9c68-w9r82" event={"ID":"39093b56-614f-4b58-b9ed-8a298e7a71ed","Type":"ContainerStarted","Data":"77dae1607e66f2b66dedba5509d366889fb0c4aaba8e51ac249bfde37dd6e802"} Jun 13 01:08:37.648076 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:37.648039 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" event={"ID":"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e","Type":"ContainerStarted","Data":"24d3f639819fb9b25c5935a149ecf2b695ad26bef4f2b4831d1ef48d6fdf8280"} Jun 13 01:08:37.648551 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:37.648138 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:37.649869 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:37.649832 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6849dc9c68-w9r82" event={"ID":"39093b56-614f-4b58-b9ed-8a298e7a71ed","Type":"ContainerStarted","Data":"4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8"} Jun 13 01:08:37.649993 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:37.649895 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:37.666664 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:37.666613 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" podStartSLOduration=1.611247818 podStartE2EDuration="3.666597146s" totalImagesPullingTime="2.055349328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:08:37.66572245 +0000 UTC m=+747.227216907" watchObservedRunningTime="2026-06-13 01:08:37.666597146 +0000 UTC m=+747.228091765" Jun 13 01:08:37.684086 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:37.684030 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6849dc9c68-w9r82" podStartSLOduration=2.049860149 podStartE2EDuration="3.684012196s" totalImagesPullingTime="1.634152047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:08:37.682942706 +0000 UTC m=+747.244437165" watchObservedRunningTime="2026-06-13 01:08:37.684012196 +0000 UTC m=+747.245506654" Jun 13 01:08:48.660517 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:48.660486 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:48.661040 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:48.660562 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:08:48.718225 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:48.718190 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6849dc9c68-w9r82"] Jun 13 01:08:48.718419 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:48.718393 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6849dc9c68-w9r82" podUID="39093b56-614f-4b58-b9ed-8a298e7a71ed" containerName="manager" containerID="cri-o://4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8" gracePeriod=30 Jun 13 01:08:48.966500 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:48.966474 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:49.041038 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.040993 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sps6g\" (UniqueName: \"kubernetes.io/projected/39093b56-614f-4b58-b9ed-8a298e7a71ed-kube-api-access-sps6g\") pod \"39093b56-614f-4b58-b9ed-8a298e7a71ed\" (UID: \"39093b56-614f-4b58-b9ed-8a298e7a71ed\") " Jun 13 01:08:49.041217 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.041200 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39093b56-614f-4b58-b9ed-8a298e7a71ed-webhook-cert\") pod \"39093b56-614f-4b58-b9ed-8a298e7a71ed\" (UID: \"39093b56-614f-4b58-b9ed-8a298e7a71ed\") " Jun 13 01:08:49.043235 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.043207 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39093b56-614f-4b58-b9ed-8a298e7a71ed-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "39093b56-614f-4b58-b9ed-8a298e7a71ed" (UID: "39093b56-614f-4b58-b9ed-8a298e7a71ed"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:08:49.043348 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.043236 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39093b56-614f-4b58-b9ed-8a298e7a71ed-kube-api-access-sps6g" (OuterVolumeSpecName: "kube-api-access-sps6g") pod "39093b56-614f-4b58-b9ed-8a298e7a71ed" (UID: "39093b56-614f-4b58-b9ed-8a298e7a71ed"). InnerVolumeSpecName "kube-api-access-sps6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:08:49.141840 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.141801 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39093b56-614f-4b58-b9ed-8a298e7a71ed-webhook-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:08:49.141840 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.141836 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sps6g\" (UniqueName: \"kubernetes.io/projected/39093b56-614f-4b58-b9ed-8a298e7a71ed-kube-api-access-sps6g\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:08:49.705514 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.705471 2563 generic.go:356] "Generic (PLEG): container finished" podID="39093b56-614f-4b58-b9ed-8a298e7a71ed" containerID="4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8" exitCode=0 Jun 13 01:08:49.705514 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.705517 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6849dc9c68-w9r82" Jun 13 01:08:49.705988 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.705565 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6849dc9c68-w9r82" event={"ID":"39093b56-614f-4b58-b9ed-8a298e7a71ed","Type":"ContainerDied","Data":"4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8"} Jun 13 01:08:49.705988 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.705617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6849dc9c68-w9r82" event={"ID":"39093b56-614f-4b58-b9ed-8a298e7a71ed","Type":"ContainerDied","Data":"77dae1607e66f2b66dedba5509d366889fb0c4aaba8e51ac249bfde37dd6e802"} Jun 13 01:08:49.705988 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.705642 2563 scope.go:117] "RemoveContainer" containerID="4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8" Jun 13 01:08:49.714225 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.714205 2563 scope.go:117] "RemoveContainer" containerID="4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8" Jun 13 01:08:49.714505 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:08:49.714483 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8\": container with ID starting with 4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8 not found: ID does not exist" containerID="4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8" Jun 13 01:08:49.714568 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.714515 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8"} err="failed to get container status \"4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8\": rpc error: code = NotFound desc = could not find container \"4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8\": container with ID starting with 4e6010b8d1d763bc125cbd323817316bf33e229a45dda52b3ecd36d0b73605f8 not found: ID does not exist" Jun 13 01:08:49.724344 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.724314 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6849dc9c68-w9r82"] Jun 13 01:08:49.727956 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:49.727928 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6849dc9c68-w9r82"] Jun 13 01:08:50.843375 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:08:50.843344 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39093b56-614f-4b58-b9ed-8a298e7a71ed" path="/var/lib/kubelet/pods/39093b56-614f-4b58-b9ed-8a298e7a71ed/volumes" Jun 13 01:09:08.504851 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.504811 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5fb66499dd-k6vq8"] Jun 13 01:09:08.505326 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.505158 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39093b56-614f-4b58-b9ed-8a298e7a71ed" containerName="manager" Jun 13 01:09:08.505326 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.505170 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="39093b56-614f-4b58-b9ed-8a298e7a71ed" containerName="manager" Jun 13 01:09:08.505326 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.505240 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="39093b56-614f-4b58-b9ed-8a298e7a71ed" containerName="manager" Jun 13 01:09:08.508273 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.508248 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:08.510047 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.510018 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 13 01:09:08.510162 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.510097 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bvsk2\"" Jun 13 01:09:08.518497 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.518471 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fb66499dd-k6vq8"] Jun 13 01:09:08.604011 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.603972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d319a5-2b07-4e93-929d-a79843b77293-maas-api-tls\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:08.604011 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.604012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d319a5-2b07-4e93-929d-a79843b77293-openshift-service-ca\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:08.604223 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.604042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55zqk\" (UniqueName: \"kubernetes.io/projected/47d319a5-2b07-4e93-929d-a79843b77293-kube-api-access-55zqk\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:08.705432 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.705396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d319a5-2b07-4e93-929d-a79843b77293-maas-api-tls\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:08.705626 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.705440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d319a5-2b07-4e93-929d-a79843b77293-openshift-service-ca\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:08.705626 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:09:08.705541 2563 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 13 01:09:08.705626 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.705558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55zqk\" (UniqueName: \"kubernetes.io/projected/47d319a5-2b07-4e93-929d-a79843b77293-kube-api-access-55zqk\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:08.705626 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:09:08.705617 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d319a5-2b07-4e93-929d-a79843b77293-maas-api-tls podName:47d319a5-2b07-4e93-929d-a79843b77293 nodeName:}" failed. No retries permitted until 2026-06-13 01:09:09.205599648 +0000 UTC m=+778.767094084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/47d319a5-2b07-4e93-929d-a79843b77293-maas-api-tls") pod "maas-api-5fb66499dd-k6vq8" (UID: "47d319a5-2b07-4e93-929d-a79843b77293") : secret "maas-api-serving-cert" not found Jun 13 01:09:08.706049 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.706033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47d319a5-2b07-4e93-929d-a79843b77293-openshift-service-ca\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:08.714186 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:08.714157 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55zqk\" (UniqueName: \"kubernetes.io/projected/47d319a5-2b07-4e93-929d-a79843b77293-kube-api-access-55zqk\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:09.150180 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:09.150146 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:09:09.209056 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:09.209006 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d319a5-2b07-4e93-929d-a79843b77293-maas-api-tls\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:09.211503 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:09.211468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47d319a5-2b07-4e93-929d-a79843b77293-maas-api-tls\") pod \"maas-api-5fb66499dd-k6vq8\" (UID: \"47d319a5-2b07-4e93-929d-a79843b77293\") " pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:09.419394 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:09.419298 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:09.552557 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:09.552523 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fb66499dd-k6vq8"] Jun 13 01:09:09.555908 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:09:09.555881 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d319a5_2b07_4e93_929d_a79843b77293.slice/crio-84e719b14b3eb75645dc98768f3f9b9730c8e0028178c1d56ff3cf3c79668983 WatchSource:0}: Error finding container 84e719b14b3eb75645dc98768f3f9b9730c8e0028178c1d56ff3cf3c79668983: Status 404 returned error can't find the container with id 84e719b14b3eb75645dc98768f3f9b9730c8e0028178c1d56ff3cf3c79668983 Jun 13 01:09:09.791380 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:09.791346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fb66499dd-k6vq8" event={"ID":"47d319a5-2b07-4e93-929d-a79843b77293","Type":"ContainerStarted","Data":"84e719b14b3eb75645dc98768f3f9b9730c8e0028178c1d56ff3cf3c79668983"} Jun 13 01:09:11.801838 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:11.801799 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fb66499dd-k6vq8" event={"ID":"47d319a5-2b07-4e93-929d-a79843b77293","Type":"ContainerStarted","Data":"4c31caad78f960a42183da5aceb0a2b395582822816ea7c796c34167821eb86d"} Jun 13 01:09:11.802240 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:11.801941 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:11.820231 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:11.820178 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5fb66499dd-k6vq8" podStartSLOduration=2.273220044 podStartE2EDuration="3.820160829s" totalImagesPullingTime="1.546940785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:09:11.819001826 +0000 UTC m=+781.380496295" watchObservedRunningTime="2026-06-13 01:09:11.820160829 +0000 UTC m=+781.381655266" Jun 13 01:09:17.811667 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:17.811631 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5fb66499dd-k6vq8" Jun 13 01:09:56.396264 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.396188 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c998dc9cc-wl8r5"] Jun 13 01:09:56.399594 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.399572 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.402006 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.401977 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b7jx6\"" Jun 13 01:09:56.402006 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.401994 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 13 01:09:56.402006 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.401983 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 13 01:09:56.407040 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.406603 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c998dc9cc-wl8r5"] Jun 13 01:09:56.516147 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.516114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2j6r\" (UniqueName: \"kubernetes.io/projected/5efd0b4d-7f57-4a37-8454-29226f921343-kube-api-access-x2j6r\") pod \"authorino-6c998dc9cc-wl8r5\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.516147 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.516150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5efd0b4d-7f57-4a37-8454-29226f921343-oidc-ca\") pod \"authorino-6c998dc9cc-wl8r5\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.516386 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.516182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5efd0b4d-7f57-4a37-8454-29226f921343-tls-cert\") pod \"authorino-6c998dc9cc-wl8r5\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.617654 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.617614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2j6r\" (UniqueName: \"kubernetes.io/projected/5efd0b4d-7f57-4a37-8454-29226f921343-kube-api-access-x2j6r\") pod \"authorino-6c998dc9cc-wl8r5\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.617654 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.617656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5efd0b4d-7f57-4a37-8454-29226f921343-oidc-ca\") pod \"authorino-6c998dc9cc-wl8r5\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.617870 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.617702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5efd0b4d-7f57-4a37-8454-29226f921343-tls-cert\") pod \"authorino-6c998dc9cc-wl8r5\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.618337 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.618315 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5efd0b4d-7f57-4a37-8454-29226f921343-oidc-ca\") pod \"authorino-6c998dc9cc-wl8r5\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.620088 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.620068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5efd0b4d-7f57-4a37-8454-29226f921343-tls-cert\") pod \"authorino-6c998dc9cc-wl8r5\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.624950 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.624920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2j6r\" (UniqueName: \"kubernetes.io/projected/5efd0b4d-7f57-4a37-8454-29226f921343-kube-api-access-x2j6r\") pod \"authorino-6c998dc9cc-wl8r5\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.710133 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.710041 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:09:56.849143 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.849110 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c998dc9cc-wl8r5"] Jun 13 01:09:56.992701 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:56.992613 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" event={"ID":"5efd0b4d-7f57-4a37-8454-29226f921343","Type":"ContainerStarted","Data":"99c400edcf34d3b70a8ebb63f085803c853f3247ea4d5371517057f8290d805b"} Jun 13 01:09:57.998480 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:57.998438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" event={"ID":"5efd0b4d-7f57-4a37-8454-29226f921343","Type":"ContainerStarted","Data":"10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228"} Jun 13 01:09:58.014696 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:09:58.014646 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" podStartSLOduration=1.721796861 podStartE2EDuration="2.014630963s" totalImagesPullingTime="292.834102ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:09:58.012286195 +0000 UTC m=+827.573780652" watchObservedRunningTime="2026-06-13 01:09:58.014630963 +0000 UTC m=+827.576125420" Jun 13 01:10:12.148894 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:10:12.148856 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:10:37.028823 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:10:37.028782 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:10:48.416974 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:10:48.416928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:11:10.847802 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:11:10.847774 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:11:10.849958 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:11:10.849937 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:11:12.326723 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:11:12.326683 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:11:25.329432 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:11:25.329386 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:11:30.627842 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:11:30.627804 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:12:46.849035 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:46.848957 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5647bc9dd-z4khl"] Jun 13 01:12:46.852206 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:46.852186 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:46.860223 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:46.860187 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5647bc9dd-z4khl"] Jun 13 01:12:46.997103 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:46.997069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh89c\" (UniqueName: \"kubernetes.io/projected/4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc-kube-api-access-zh89c\") pod \"authorino-5647bc9dd-z4khl\" (UID: \"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc\") " pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:46.997309 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:46.997116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc-oidc-ca\") pod \"authorino-5647bc9dd-z4khl\" (UID: \"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc\") " pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:46.997309 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:46.997207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc-tls-cert\") pod \"authorino-5647bc9dd-z4khl\" (UID: \"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc\") " pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:47.097993 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.097959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh89c\" (UniqueName: \"kubernetes.io/projected/4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc-kube-api-access-zh89c\") pod \"authorino-5647bc9dd-z4khl\" (UID: \"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc\") " pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:47.098112 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.098002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc-oidc-ca\") pod \"authorino-5647bc9dd-z4khl\" (UID: \"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc\") " pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:47.098112 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.098037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc-tls-cert\") pod \"authorino-5647bc9dd-z4khl\" (UID: \"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc\") " pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:47.098674 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.098648 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc-oidc-ca\") pod \"authorino-5647bc9dd-z4khl\" (UID: \"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc\") " pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:47.100364 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.100314 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc-tls-cert\") pod \"authorino-5647bc9dd-z4khl\" (UID: \"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc\") " pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:47.106104 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.106083 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh89c\" (UniqueName: \"kubernetes.io/projected/4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc-kube-api-access-zh89c\") pod \"authorino-5647bc9dd-z4khl\" (UID: \"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc\") " pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:47.162730 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.162689 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5647bc9dd-z4khl" Jun 13 01:12:47.295095 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.295066 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5647bc9dd-z4khl"] Jun 13 01:12:47.298608 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:12:47.298581 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cd085b7_e37a_4dd7_9f1a_dcf0744b21dc.slice/crio-b2b7fedcd6931399a26e11fad6201ae50269e8df8d47d8c0014c881296e1f91d WatchSource:0}: Error finding container b2b7fedcd6931399a26e11fad6201ae50269e8df8d47d8c0014c881296e1f91d: Status 404 returned error can't find the container with id b2b7fedcd6931399a26e11fad6201ae50269e8df8d47d8c0014c881296e1f91d Jun 13 01:12:47.299992 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.299972 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:12:47.739294 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.739255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5647bc9dd-z4khl" event={"ID":"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc","Type":"ContainerStarted","Data":"8f1e4b6f5eea725c47d21ef2e2a053a05aae03b24aa550dd8e24b74cc0d08365"} Jun 13 01:12:47.739294 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.739295 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5647bc9dd-z4khl" event={"ID":"4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc","Type":"ContainerStarted","Data":"b2b7fedcd6931399a26e11fad6201ae50269e8df8d47d8c0014c881296e1f91d"} Jun 13 01:12:47.755045 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.754987 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5647bc9dd-z4khl" podStartSLOduration=1.397604582 podStartE2EDuration="1.75497018s" totalImagesPullingTime="357.365598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:12:47.753301294 +0000 UTC m=+997.314795754" watchObservedRunningTime="2026-06-13 01:12:47.75497018 +0000 UTC m=+997.316464638" Jun 13 01:12:47.783121 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.783086 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c998dc9cc-wl8r5"] Jun 13 01:12:47.783304 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:47.783277 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" podUID="5efd0b4d-7f57-4a37-8454-29226f921343" containerName="authorino" containerID="cri-o://10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228" gracePeriod=30 Jun 13 01:12:48.025370 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.025342 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:12:48.108526 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.108488 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2j6r\" (UniqueName: \"kubernetes.io/projected/5efd0b4d-7f57-4a37-8454-29226f921343-kube-api-access-x2j6r\") pod \"5efd0b4d-7f57-4a37-8454-29226f921343\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " Jun 13 01:12:48.108526 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.108543 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5efd0b4d-7f57-4a37-8454-29226f921343-tls-cert\") pod \"5efd0b4d-7f57-4a37-8454-29226f921343\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " Jun 13 01:12:48.108817 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.108581 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5efd0b4d-7f57-4a37-8454-29226f921343-oidc-ca\") pod \"5efd0b4d-7f57-4a37-8454-29226f921343\" (UID: \"5efd0b4d-7f57-4a37-8454-29226f921343\") " Jun 13 01:12:48.112299 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.112249 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5efd0b4d-7f57-4a37-8454-29226f921343-kube-api-access-x2j6r" (OuterVolumeSpecName: "kube-api-access-x2j6r") pod "5efd0b4d-7f57-4a37-8454-29226f921343" (UID: "5efd0b4d-7f57-4a37-8454-29226f921343"). InnerVolumeSpecName "kube-api-access-x2j6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:12:48.115705 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.115668 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5efd0b4d-7f57-4a37-8454-29226f921343-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "5efd0b4d-7f57-4a37-8454-29226f921343" (UID: "5efd0b4d-7f57-4a37-8454-29226f921343"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:12:48.120330 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.120180 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5efd0b4d-7f57-4a37-8454-29226f921343-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5efd0b4d-7f57-4a37-8454-29226f921343" (UID: "5efd0b4d-7f57-4a37-8454-29226f921343"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:12:48.210163 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.210077 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2j6r\" (UniqueName: \"kubernetes.io/projected/5efd0b4d-7f57-4a37-8454-29226f921343-kube-api-access-x2j6r\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:12:48.210163 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.210109 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5efd0b4d-7f57-4a37-8454-29226f921343-tls-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:12:48.210163 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.210119 2563 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5efd0b4d-7f57-4a37-8454-29226f921343-oidc-ca\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:12:48.748167 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.747182 2563 generic.go:356] "Generic (PLEG): container finished" podID="5efd0b4d-7f57-4a37-8454-29226f921343" containerID="10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228" exitCode=0 Jun 13 01:12:48.748167 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.747823 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" Jun 13 01:12:48.748167 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.748095 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" event={"ID":"5efd0b4d-7f57-4a37-8454-29226f921343","Type":"ContainerDied","Data":"10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228"} Jun 13 01:12:48.748167 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.748147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c998dc9cc-wl8r5" event={"ID":"5efd0b4d-7f57-4a37-8454-29226f921343","Type":"ContainerDied","Data":"99c400edcf34d3b70a8ebb63f085803c853f3247ea4d5371517057f8290d805b"} Jun 13 01:12:48.748167 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.748173 2563 scope.go:117] "RemoveContainer" containerID="10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228" Jun 13 01:12:48.758282 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.758265 2563 scope.go:117] "RemoveContainer" containerID="10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228" Jun 13 01:12:48.758550 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:12:48.758532 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228\": container with ID starting with 10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228 not found: ID does not exist" containerID="10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228" Jun 13 01:12:48.758626 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.758563 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228"} err="failed to get container status \"10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228\": rpc error: code = NotFound desc = could not find container \"10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228\": container with ID starting with 10f27aa57e815bce15b76d0347827ddb3b0ea73a876be7eaf342b04a25d3f228 not found: ID does not exist" Jun 13 01:12:48.775174 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.775142 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c998dc9cc-wl8r5"] Jun 13 01:12:48.779369 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.779345 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c998dc9cc-wl8r5"] Jun 13 01:12:48.842486 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:12:48.842452 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5efd0b4d-7f57-4a37-8454-29226f921343" path="/var/lib/kubelet/pods/5efd0b4d-7f57-4a37-8454-29226f921343/volumes" Jun 13 01:13:19.126501 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:13:19.126460 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:13:30.022815 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:13:30.022775 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:13:38.629157 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:13:38.629121 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:13:48.828662 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:13:48.828628 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:13:57.721367 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:13:57.721255 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:14:08.527201 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:08.527155 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:14:16.010954 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.010919 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b6b769cc9-8fqld"] Jun 13 01:14:16.011546 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.011141 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" podUID="adfbbf21-fc21-4ba4-9088-fd6cfd08f40e" containerName="manager" containerID="cri-o://24d3f639819fb9b25c5935a149ecf2b695ad26bef4f2b4831d1ef48d6fdf8280" gracePeriod=30 Jun 13 01:14:16.138009 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.137975 2563 generic.go:356] "Generic (PLEG): container finished" podID="adfbbf21-fc21-4ba4-9088-fd6cfd08f40e" containerID="24d3f639819fb9b25c5935a149ecf2b695ad26bef4f2b4831d1ef48d6fdf8280" exitCode=0 Jun 13 01:14:16.138157 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.138028 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" event={"ID":"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e","Type":"ContainerDied","Data":"24d3f639819fb9b25c5935a149ecf2b695ad26bef4f2b4831d1ef48d6fdf8280"} Jun 13 01:14:16.258100 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.258074 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:14:16.341695 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.341658 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvpmj\" (UniqueName: \"kubernetes.io/projected/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-kube-api-access-dvpmj\") pod \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\" (UID: \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\") " Jun 13 01:14:16.341901 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.341721 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-webhook-cert\") pod \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\" (UID: \"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e\") " Jun 13 01:14:16.343762 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.343719 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "adfbbf21-fc21-4ba4-9088-fd6cfd08f40e" (UID: "adfbbf21-fc21-4ba4-9088-fd6cfd08f40e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:14:16.343907 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.343796 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-kube-api-access-dvpmj" (OuterVolumeSpecName: "kube-api-access-dvpmj") pod "adfbbf21-fc21-4ba4-9088-fd6cfd08f40e" (UID: "adfbbf21-fc21-4ba4-9088-fd6cfd08f40e"). InnerVolumeSpecName "kube-api-access-dvpmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:14:16.443336 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.443285 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvpmj\" (UniqueName: \"kubernetes.io/projected/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-kube-api-access-dvpmj\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:14:16.443336 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:16.443328 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e-webhook-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:14:17.144172 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.144092 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" Jun 13 01:14:17.144172 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.144099 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6b769cc9-8fqld" event={"ID":"adfbbf21-fc21-4ba4-9088-fd6cfd08f40e","Type":"ContainerDied","Data":"a20d2ca65c79efc7a74e96fc75392a82ca18654e6d23c1839666749ec084bdad"} Jun 13 01:14:17.144629 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.144212 2563 scope.go:117] "RemoveContainer" containerID="24d3f639819fb9b25c5935a149ecf2b695ad26bef4f2b4831d1ef48d6fdf8280" Jun 13 01:14:17.159351 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.159324 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b6b769cc9-8fqld"] Jun 13 01:14:17.163084 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.163061 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b6b769cc9-8fqld"] Jun 13 01:14:17.934991 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.934959 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b6b769cc9-hl5sb"] Jun 13 01:14:17.935300 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.935287 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5efd0b4d-7f57-4a37-8454-29226f921343" containerName="authorino" Jun 13 01:14:17.935351 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.935302 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5efd0b4d-7f57-4a37-8454-29226f921343" containerName="authorino" Jun 13 01:14:17.935351 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.935317 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adfbbf21-fc21-4ba4-9088-fd6cfd08f40e" containerName="manager" Jun 13 01:14:17.935351 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.935322 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="adfbbf21-fc21-4ba4-9088-fd6cfd08f40e" containerName="manager" Jun 13 01:14:17.935440 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.935383 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="adfbbf21-fc21-4ba4-9088-fd6cfd08f40e" containerName="manager" Jun 13 01:14:17.935440 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.935392 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5efd0b4d-7f57-4a37-8454-29226f921343" containerName="authorino" Jun 13 01:14:17.939393 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.939370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:17.941767 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.941728 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-stqd6\"" Jun 13 01:14:17.941899 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.941811 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 13 01:14:17.941899 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.941755 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 13 01:14:17.949583 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:17.949558 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6b769cc9-hl5sb"] Jun 13 01:14:18.057060 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:18.057017 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkngs\" (UniqueName: \"kubernetes.io/projected/3547b23c-0cb8-4373-8f3d-ffcd632fe1f4-kube-api-access-kkngs\") pod \"maas-controller-6b6b769cc9-hl5sb\" (UID: \"3547b23c-0cb8-4373-8f3d-ffcd632fe1f4\") " pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:18.057248 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:18.057100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3547b23c-0cb8-4373-8f3d-ffcd632fe1f4-webhook-cert\") pod \"maas-controller-6b6b769cc9-hl5sb\" (UID: \"3547b23c-0cb8-4373-8f3d-ffcd632fe1f4\") " pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:18.157729 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:18.157696 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkngs\" (UniqueName: \"kubernetes.io/projected/3547b23c-0cb8-4373-8f3d-ffcd632fe1f4-kube-api-access-kkngs\") pod \"maas-controller-6b6b769cc9-hl5sb\" (UID: \"3547b23c-0cb8-4373-8f3d-ffcd632fe1f4\") " pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:18.158150 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:18.157792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3547b23c-0cb8-4373-8f3d-ffcd632fe1f4-webhook-cert\") pod \"maas-controller-6b6b769cc9-hl5sb\" (UID: \"3547b23c-0cb8-4373-8f3d-ffcd632fe1f4\") " pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:18.160261 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:18.160240 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3547b23c-0cb8-4373-8f3d-ffcd632fe1f4-webhook-cert\") pod \"maas-controller-6b6b769cc9-hl5sb\" (UID: \"3547b23c-0cb8-4373-8f3d-ffcd632fe1f4\") " pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:18.165148 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:18.165123 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkngs\" (UniqueName: \"kubernetes.io/projected/3547b23c-0cb8-4373-8f3d-ffcd632fe1f4-kube-api-access-kkngs\") pod \"maas-controller-6b6b769cc9-hl5sb\" (UID: \"3547b23c-0cb8-4373-8f3d-ffcd632fe1f4\") " pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:18.249944 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:18.249843 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:18.382727 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:18.382696 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6b769cc9-hl5sb"] Jun 13 01:14:18.385249 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:14:18.385223 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3547b23c_0cb8_4373_8f3d_ffcd632fe1f4.slice/crio-e1fd9c68fc3d1341720c961c9baf68f2fb03fd461587cf8ad05da8334e5ef7c2 WatchSource:0}: Error finding container e1fd9c68fc3d1341720c961c9baf68f2fb03fd461587cf8ad05da8334e5ef7c2: Status 404 returned error can't find the container with id e1fd9c68fc3d1341720c961c9baf68f2fb03fd461587cf8ad05da8334e5ef7c2 Jun 13 01:14:18.842988 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:18.842956 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adfbbf21-fc21-4ba4-9088-fd6cfd08f40e" path="/var/lib/kubelet/pods/adfbbf21-fc21-4ba4-9088-fd6cfd08f40e/volumes" Jun 13 01:14:19.155509 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:19.155410 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" event={"ID":"3547b23c-0cb8-4373-8f3d-ffcd632fe1f4","Type":"ContainerStarted","Data":"abd15b72155a3a27503328bad069549a51c729b4a66485d0b983783bcf75056c"} Jun 13 01:14:19.155509 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:19.155471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" event={"ID":"3547b23c-0cb8-4373-8f3d-ffcd632fe1f4","Type":"ContainerStarted","Data":"e1fd9c68fc3d1341720c961c9baf68f2fb03fd461587cf8ad05da8334e5ef7c2"} Jun 13 01:14:19.155509 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:19.155497 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:19.172868 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:19.172799 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" podStartSLOduration=1.74279439 podStartE2EDuration="2.172778737s" totalImagesPullingTime="429.984347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:19.172439774 +0000 UTC m=+1088.733934231" watchObservedRunningTime="2026-06-13 01:14:19.172778737 +0000 UTC m=+1088.734273197" Jun 13 01:14:30.165191 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:30.165153 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b6b769cc9-hl5sb" Jun 13 01:14:41.279850 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:41.279808 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:14:45.725391 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:14:45.725348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:15:00.148161 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:00.148117 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688555-gcx4p"] Jun 13 01:15:00.151585 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:00.151558 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" Jun 13 01:15:00.161018 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:00.160303 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688555-gcx4p"] Jun 13 01:15:00.221293 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:00.221256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbm2j\" (UniqueName: \"kubernetes.io/projected/9878d8b3-f49e-485b-9091-d1ea46f191e4-kube-api-access-cbm2j\") pod \"maas-api-key-cleanup-29688555-gcx4p\" (UID: \"9878d8b3-f49e-485b-9091-d1ea46f191e4\") " pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" Jun 13 01:15:00.322729 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:00.322675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbm2j\" (UniqueName: \"kubernetes.io/projected/9878d8b3-f49e-485b-9091-d1ea46f191e4-kube-api-access-cbm2j\") pod \"maas-api-key-cleanup-29688555-gcx4p\" (UID: \"9878d8b3-f49e-485b-9091-d1ea46f191e4\") " pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" Jun 13 01:15:00.330877 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:00.330851 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbm2j\" (UniqueName: \"kubernetes.io/projected/9878d8b3-f49e-485b-9091-d1ea46f191e4-kube-api-access-cbm2j\") pod \"maas-api-key-cleanup-29688555-gcx4p\" (UID: \"9878d8b3-f49e-485b-9091-d1ea46f191e4\") " pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" Jun 13 01:15:00.471121 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:00.471017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" Jun 13 01:15:00.598679 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:00.598648 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688555-gcx4p"] Jun 13 01:15:00.601500 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:15:00.601475 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9878d8b3_f49e_485b_9091_d1ea46f191e4.slice/crio-a2ecdffe8121406026062363785494159a61f7e27541efbc518fce093057ff5b WatchSource:0}: Error finding container a2ecdffe8121406026062363785494159a61f7e27541efbc518fce093057ff5b: Status 404 returned error can't find the container with id a2ecdffe8121406026062363785494159a61f7e27541efbc518fce093057ff5b Jun 13 01:15:01.346055 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:01.346017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" event={"ID":"9878d8b3-f49e-485b-9091-d1ea46f191e4","Type":"ContainerStarted","Data":"a2ecdffe8121406026062363785494159a61f7e27541efbc518fce093057ff5b"} Jun 13 01:15:03.357706 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:03.357671 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" event={"ID":"9878d8b3-f49e-485b-9091-d1ea46f191e4","Type":"ContainerStarted","Data":"6a47d391d7aefd6c529d256ffa79a30b91f446139f422f439e01a1433adf506b"} Jun 13 01:15:03.373520 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:03.373465 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" podStartSLOduration=1.11161112 podStartE2EDuration="3.373448982s" totalImagesPullingTime="2.261837862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:03.372112145 +0000 UTC m=+1132.933606605" watchObservedRunningTime="2026-06-13 01:15:03.373448982 +0000 UTC m=+1132.934943440" Jun 13 01:15:04.363701 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:04.363668 2563 generic.go:356] "Generic (PLEG): container finished" podID="9878d8b3-f49e-485b-9091-d1ea46f191e4" containerID="6a47d391d7aefd6c529d256ffa79a30b91f446139f422f439e01a1433adf506b" exitCode=0 Jun 13 01:15:04.364092 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:04.363717 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" event={"ID":"9878d8b3-f49e-485b-9091-d1ea46f191e4","Type":"ContainerDied","Data":"6a47d391d7aefd6c529d256ffa79a30b91f446139f422f439e01a1433adf506b"} Jun 13 01:15:05.498204 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:05.498172 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" Jun 13 01:15:05.566998 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:05.566959 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbm2j\" (UniqueName: \"kubernetes.io/projected/9878d8b3-f49e-485b-9091-d1ea46f191e4-kube-api-access-cbm2j\") pod \"9878d8b3-f49e-485b-9091-d1ea46f191e4\" (UID: \"9878d8b3-f49e-485b-9091-d1ea46f191e4\") " Jun 13 01:15:05.569019 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:05.568992 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9878d8b3-f49e-485b-9091-d1ea46f191e4-kube-api-access-cbm2j" (OuterVolumeSpecName: "kube-api-access-cbm2j") pod "9878d8b3-f49e-485b-9091-d1ea46f191e4" (UID: "9878d8b3-f49e-485b-9091-d1ea46f191e4"). InnerVolumeSpecName "kube-api-access-cbm2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:15:05.667829 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:05.667720 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbm2j\" (UniqueName: \"kubernetes.io/projected/9878d8b3-f49e-485b-9091-d1ea46f191e4-kube-api-access-cbm2j\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:15:06.379387 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:06.379352 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" event={"ID":"9878d8b3-f49e-485b-9091-d1ea46f191e4","Type":"ContainerDied","Data":"a2ecdffe8121406026062363785494159a61f7e27541efbc518fce093057ff5b"} Jun 13 01:15:06.379558 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:06.379404 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2ecdffe8121406026062363785494159a61f7e27541efbc518fce093057ff5b" Jun 13 01:15:06.379558 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:06.379363 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688555-gcx4p" Jun 13 01:15:25.862064 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:25.861964 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:15:41.630406 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:15:41.630364 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:16:10.880298 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:16:10.880264 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:16:10.882750 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:16:10.882716 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:16:20.240280 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:16:20.240243 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:16:36.733710 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:16:36.733668 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:16:50.982443 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:16:50.982404 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:17:06.226151 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:17:06.226109 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:17:09.923773 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:17:09.923724 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:17:41.818145 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:17:41.818104 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:17:46.315282 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:17:46.315245 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:18:07.015934 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:18:07.015895 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:18:15.915023 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:18:15.914987 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:18:32.819406 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:18:32.819329 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:18:41.427932 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:18:41.427890 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:18:58.918254 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:18:58.918218 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:19:06.815387 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:19:06.815349 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:19:39.718110 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:19:39.718067 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:19:48.618013 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:19:48.617975 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:19:57.316720 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:19:57.316629 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:20:04.915089 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:20:04.915052 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:20:13.311215 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:20:13.311179 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:20:38.812769 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:20:38.812712 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:20:52.315012 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:20:52.314968 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:21:10.908762 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:21:10.908714 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:21:10.911447 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:21:10.911426 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:21:20.521421 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:21:20.521385 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:21:23.123068 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:21:23.122969 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:21:39.618384 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:21:39.618348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:21:47.423258 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:21:47.423220 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:22:06.320303 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:22:06.320265 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:22:14.919771 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:22:14.919721 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:22:23.717028 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:22:23.716986 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:22:32.717408 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:22:32.717370 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:22:41.526918 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:22:41.526881 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:22:49.810971 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:22:49.810930 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:22:59.116861 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:22:59.116769 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:23:07.325448 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:23:07.325402 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:23:15.817769 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:23:15.817722 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:23:24.011053 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:23:24.011017 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:25:46.317454 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:25:46.317411 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:25:50.807864 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:25:50.807826 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:26:10.936703 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:26:10.936677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:26:10.940861 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:26:10.940835 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:26:15.823320 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:26:15.823276 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:26:20.518259 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:26:20.518213 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:26:27.625770 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:26:27.621938 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:26:38.215980 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:26:38.215929 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:26:47.018493 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:26:47.018453 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:26:58.018170 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:26:58.018139 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:27:06.415260 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:27:06.415222 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:27:17.012055 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:27:17.012015 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:27:25.817459 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:27:25.817374 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:27:36.734849 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:27:36.734812 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:27:45.415010 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:27:45.414966 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:27:50.219927 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:27:50.219877 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:28:18.314309 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:28:18.314271 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:29:01.318673 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:29:01.318582 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:29:09.534356 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:29:09.534315 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:29:18.526159 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:29:18.526122 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:29:27.117157 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:29:27.117114 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:29:35.733351 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:29:35.733311 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:29:46.429943 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:29:46.429904 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:29:55.304122 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:29:55.304084 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:30:00.134599 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.134554 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688570-vmcxv"] Jun 13 01:30:00.135110 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.134939 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9878d8b3-f49e-485b-9091-d1ea46f191e4" containerName="cleanup" Jun 13 01:30:00.135110 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.134951 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9878d8b3-f49e-485b-9091-d1ea46f191e4" containerName="cleanup" Jun 13 01:30:00.135110 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.135017 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9878d8b3-f49e-485b-9091-d1ea46f191e4" containerName="cleanup" Jun 13 01:30:00.138011 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.137991 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" Jun 13 01:30:00.154173 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.154141 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688570-vmcxv"] Jun 13 01:30:00.165762 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.165707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k48l9\" (UniqueName: \"kubernetes.io/projected/9565b696-a182-4423-8c74-1bcf98f584c4-kube-api-access-k48l9\") pod \"maas-api-key-cleanup-29688570-vmcxv\" (UID: \"9565b696-a182-4423-8c74-1bcf98f584c4\") " pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" Jun 13 01:30:00.267186 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.267135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k48l9\" (UniqueName: \"kubernetes.io/projected/9565b696-a182-4423-8c74-1bcf98f584c4-kube-api-access-k48l9\") pod \"maas-api-key-cleanup-29688570-vmcxv\" (UID: \"9565b696-a182-4423-8c74-1bcf98f584c4\") " pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" Jun 13 01:30:00.280944 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.280910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k48l9\" (UniqueName: \"kubernetes.io/projected/9565b696-a182-4423-8c74-1bcf98f584c4-kube-api-access-k48l9\") pod \"maas-api-key-cleanup-29688570-vmcxv\" (UID: \"9565b696-a182-4423-8c74-1bcf98f584c4\") " pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" Jun 13 01:30:00.447987 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.447895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" Jun 13 01:30:00.580645 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.580464 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688570-vmcxv"] Jun 13 01:30:00.583683 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:30:00.583655 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9565b696_a182_4423_8c74_1bcf98f584c4.slice/crio-76954ec77c3b7130b5f351fa71734d749bf8ae0d43c5e286e4540015679a557e WatchSource:0}: Error finding container 76954ec77c3b7130b5f351fa71734d749bf8ae0d43c5e286e4540015679a557e: Status 404 returned error can't find the container with id 76954ec77c3b7130b5f351fa71734d749bf8ae0d43c5e286e4540015679a557e Jun 13 01:30:00.726232 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:00.726143 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:30:01.406926 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:01.406883 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" event={"ID":"9565b696-a182-4423-8c74-1bcf98f584c4","Type":"ContainerStarted","Data":"31f66100645afad615517a5170aa84b3fa0d304c3376d1f50dc7542852c9468d"} Jun 13 01:30:01.407314 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:01.406949 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" event={"ID":"9565b696-a182-4423-8c74-1bcf98f584c4","Type":"ContainerStarted","Data":"76954ec77c3b7130b5f351fa71734d749bf8ae0d43c5e286e4540015679a557e"} Jun 13 01:30:01.424388 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:01.424332 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" podStartSLOduration=1.4243150070000001 podStartE2EDuration="1.424315007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:30:01.422976124 +0000 UTC m=+2030.984470585" watchObservedRunningTime="2026-06-13 01:30:01.424315007 +0000 UTC m=+2030.985809468" Jun 13 01:30:02.413511 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:02.413466 2563 generic.go:356] "Generic (PLEG): container finished" podID="9565b696-a182-4423-8c74-1bcf98f584c4" containerID="31f66100645afad615517a5170aa84b3fa0d304c3376d1f50dc7542852c9468d" exitCode=0 Jun 13 01:30:02.414029 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:02.413558 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" event={"ID":"9565b696-a182-4423-8c74-1bcf98f584c4","Type":"ContainerDied","Data":"31f66100645afad615517a5170aa84b3fa0d304c3376d1f50dc7542852c9468d"} Jun 13 01:30:03.550338 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:03.550309 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" Jun 13 01:30:03.594213 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:03.594162 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k48l9\" (UniqueName: \"kubernetes.io/projected/9565b696-a182-4423-8c74-1bcf98f584c4-kube-api-access-k48l9\") pod \"9565b696-a182-4423-8c74-1bcf98f584c4\" (UID: \"9565b696-a182-4423-8c74-1bcf98f584c4\") " Jun 13 01:30:03.596269 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:03.596240 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9565b696-a182-4423-8c74-1bcf98f584c4-kube-api-access-k48l9" (OuterVolumeSpecName: "kube-api-access-k48l9") pod "9565b696-a182-4423-8c74-1bcf98f584c4" (UID: "9565b696-a182-4423-8c74-1bcf98f584c4"). InnerVolumeSpecName "kube-api-access-k48l9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:30:03.695167 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:03.695071 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k48l9\" (UniqueName: \"kubernetes.io/projected/9565b696-a182-4423-8c74-1bcf98f584c4-kube-api-access-k48l9\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:30:04.423331 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:04.423301 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" Jun 13 01:30:04.423331 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:04.423313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688570-vmcxv" event={"ID":"9565b696-a182-4423-8c74-1bcf98f584c4","Type":"ContainerDied","Data":"76954ec77c3b7130b5f351fa71734d749bf8ae0d43c5e286e4540015679a557e"} Jun 13 01:30:04.423558 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:04.423356 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76954ec77c3b7130b5f351fa71734d749bf8ae0d43c5e286e4540015679a557e" Jun 13 01:30:07.622440 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:07.622401 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:30:15.215613 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:15.215571 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:30:24.129659 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:24.129562 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:30:34.422456 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:34.422421 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:30:52.530285 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:30:52.530246 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:31:00.822150 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:31:00.822118 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:31:09.732924 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:31:09.732884 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:31:10.966317 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:31:10.966286 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:31:10.971376 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:31:10.971357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l98pw_6b08dc7d-4f48-4252-a8c7-bdb4058d9a5c/ovn-acl-logging/0.log" Jun 13 01:31:18.321381 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:31:18.321339 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:31:35.243388 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:31:35.243337 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:31:42.918190 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:31:42.918149 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:31:52.521874 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:31:52.521779 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:32:00.824272 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:32:00.824232 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:32:09.733952 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:32:09.733915 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:32:18.322923 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:32:18.322886 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:32:27.016784 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:32:27.016723 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:32:38.016687 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:32:38.016655 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:32:47.219555 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:32:47.219515 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:32:58.019449 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:32:58.019404 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:33:07.417429 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:33:07.417391 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:33:12.817924 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:33:12.817876 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:33:19.917182 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:33:19.917141 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:33:25.117487 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:33:25.117394 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:33:39.515265 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:33:39.515228 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:33:48.411656 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:33:48.411618 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:33:57.525078 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:33:57.525037 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:34:03.418863 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:03.418828 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:34:25.213162 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:25.213124 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:34:37.620985 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:37.620948 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8hdlb"] Jun 13 01:34:38.400758 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.398240 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn"] Jun 13 01:34:38.400758 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.398838 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9565b696-a182-4423-8c74-1bcf98f584c4" containerName="cleanup" Jun 13 01:34:38.400758 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.398856 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9565b696-a182-4423-8c74-1bcf98f584c4" containerName="cleanup" Jun 13 01:34:38.400758 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.398955 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9565b696-a182-4423-8c74-1bcf98f584c4" containerName="cleanup" Jun 13 01:34:38.403662 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.403637 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.409066 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.409043 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c0f26516-openshift-default-dockercfg-cfdhx\"" Jun 13 01:34:38.409265 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.409247 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 13 01:34:38.428301 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.428275 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn"] Jun 13 01:34:38.555025 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.554981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-data\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.555025 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.555027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-envoy\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.555281 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.555059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76rfn\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-kube-api-access-76rfn\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.555281 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.555140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-certs\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.555281 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.555177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04594b82-a635-4a8d-bde8-15e1194de40f-istio-podinfo\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.555281 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.555229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-credential-socket\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.555281 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.555266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-istio-token\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.555549 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.555286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04594b82-a635-4a8d-bde8-15e1194de40f-istiod-ca-cert\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.555549 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.555329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-socket\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657045 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.656919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-data\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657045 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-envoy\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657541 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76rfn\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-kube-api-access-76rfn\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657541 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-certs\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657541 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04594b82-a635-4a8d-bde8-15e1194de40f-istio-podinfo\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657541 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-credential-socket\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657541 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-istio-token\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657541 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04594b82-a635-4a8d-bde8-15e1194de40f-istiod-ca-cert\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657541 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-socket\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.657541 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-data\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.658010 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.657806 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-socket\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.658190 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.658161 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04594b82-a635-4a8d-bde8-15e1194de40f-istiod-ca-cert\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.658357 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.658333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-certs\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.658478 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.658461 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-credential-socket\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.660189 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.660164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-envoy\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.660365 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.660346 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04594b82-a635-4a8d-bde8-15e1194de40f-istio-podinfo\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.678487 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.678458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76rfn\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-kube-api-access-76rfn\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.678625 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.678518 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-istio-token\") pod \"e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.728666 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.728620 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:38.864092 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.864063 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn"] Jun 13 01:34:38.866576 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:34:38.866548 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04594b82_a635_4a8d_bde8_15e1194de40f.slice/crio-04e9ac25f7b6c5fb5c69d13e69b5e24255a2a72eb4d57957948b285b794fe3da WatchSource:0}: Error finding container 04e9ac25f7b6c5fb5c69d13e69b5e24255a2a72eb4d57957948b285b794fe3da: Status 404 returned error can't find the container with id 04e9ac25f7b6c5fb5c69d13e69b5e24255a2a72eb4d57957948b285b794fe3da Jun 13 01:34:38.868524 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:38.868508 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:34:39.650926 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:39.650891 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" event={"ID":"04594b82-a635-4a8d-bde8-15e1194de40f","Type":"ContainerStarted","Data":"04e9ac25f7b6c5fb5c69d13e69b5e24255a2a72eb4d57957948b285b794fe3da"} Jun 13 01:34:42.273929 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:42.273877 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 01:34:42.274217 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:42.273969 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 01:34:42.274217 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:42.274000 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 01:34:42.667509 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:42.667420 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" event={"ID":"04594b82-a635-4a8d-bde8-15e1194de40f","Type":"ContainerStarted","Data":"52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc"} Jun 13 01:34:42.686184 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:42.686140 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" podStartSLOduration=1.281212813 podStartE2EDuration="4.686125317s" totalImagesPullingTime="3.404912504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:34:42.683672108 +0000 UTC m=+2312.245166566" watchObservedRunningTime="2026-06-13 01:34:42.686125317 +0000 UTC m=+2312.247619850" Jun 13 01:34:42.729058 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:42.729023 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:43.733892 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:43.733847 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:44.677317 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:44.677280 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:44.678147 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:44.678124 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:44.844614 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:44.844580 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn"] Jun 13 01:34:45.681816 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:45.681785 2563 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" secret="" err="secret \"e2e-ait-c0f26516-openshift-default-dockercfg-cfdhx\" not found" Jun 13 01:34:46.686338 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:46.686299 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" podUID="04594b82-a635-4a8d-bde8-15e1194de40f" containerName="istio-proxy" containerID="cri-o://52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc" gracePeriod=30 Jun 13 01:34:50.932459 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.932421 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c"] Jun 13 01:34:50.936478 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.936452 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:50.938248 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.938226 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9012b8f7-openshift-default-dockercfg-m7wjs\"" Jun 13 01:34:50.946177 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.946152 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c"] Jun 13 01:34:50.959495 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.959471 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-certs\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:50.959632 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.959517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-socket\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:50.959632 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.959537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-istio-token\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:50.959632 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.959581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-credential-socket\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:50.959774 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.959662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042104bb-5999-431d-b936-59016bfdae26-istiod-ca-cert\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:50.959844 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.959823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-envoy\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:50.959909 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.959857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042104bb-5999-431d-b936-59016bfdae26-istio-podinfo\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:50.959962 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.959931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw2fg\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-kube-api-access-rw2fg\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:50.960020 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:50.959988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-data\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.060471 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-data\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.060471 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-certs\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.060685 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060503 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-socket\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.060723 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-istio-token\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.060781 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-credential-socket\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.060828 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042104bb-5999-431d-b936-59016bfdae26-istiod-ca-cert\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.060892 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060876 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-envoy\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.060943 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060901 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-socket\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.060943 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042104bb-5999-431d-b936-59016bfdae26-istio-podinfo\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.061043 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-certs\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.061043 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060961 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw2fg\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-kube-api-access-rw2fg\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.061043 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.060987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-data\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.061260 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.061226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-credential-socket\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.061605 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.061583 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042104bb-5999-431d-b936-59016bfdae26-istiod-ca-cert\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.063098 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.063077 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-envoy\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.063284 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.063267 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042104bb-5999-431d-b936-59016bfdae26-istio-podinfo\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.067501 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.067479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-istio-token\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.067755 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.067715 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw2fg\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-kube-api-access-rw2fg\") pod \"e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.248945 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.248852 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:51.383277 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.383252 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c"] Jun 13 01:34:51.385451 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:34:51.385424 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042104bb_5999_431d_b936_59016bfdae26.slice/crio-6f48c1d281da2d17da9041efa550ebaa5478e12e0ca417246670ad2a5ddf0f86 WatchSource:0}: Error finding container 6f48c1d281da2d17da9041efa550ebaa5478e12e0ca417246670ad2a5ddf0f86: Status 404 returned error can't find the container with id 6f48c1d281da2d17da9041efa550ebaa5478e12e0ca417246670ad2a5ddf0f86 Jun 13 01:34:51.387711 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.387677 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 01:34:51.387806 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.387771 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 01:34:51.387846 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.387805 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 13 01:34:51.713003 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.712962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" event={"ID":"042104bb-5999-431d-b936-59016bfdae26","Type":"ContainerStarted","Data":"292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b"} Jun 13 01:34:51.713127 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.713016 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" event={"ID":"042104bb-5999-431d-b936-59016bfdae26","Type":"ContainerStarted","Data":"6f48c1d281da2d17da9041efa550ebaa5478e12e0ca417246670ad2a5ddf0f86"} Jun 13 01:34:51.731511 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.731466 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" podStartSLOduration=1.731450453 podStartE2EDuration="1.731450453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:34:51.730665133 +0000 UTC m=+2321.292159591" watchObservedRunningTime="2026-06-13 01:34:51.731450453 +0000 UTC m=+2321.292944913" Jun 13 01:34:51.924108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.924080 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:51.970566 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970473 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04594b82-a635-4a8d-bde8-15e1194de40f-istiod-ca-cert\") pod \"04594b82-a635-4a8d-bde8-15e1194de40f\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " Jun 13 01:34:51.970566 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970543 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-certs\") pod \"04594b82-a635-4a8d-bde8-15e1194de40f\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " Jun 13 01:34:51.970566 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970560 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-istio-token\") pod \"04594b82-a635-4a8d-bde8-15e1194de40f\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970592 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04594b82-a635-4a8d-bde8-15e1194de40f-istio-podinfo\") pod \"04594b82-a635-4a8d-bde8-15e1194de40f\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970611 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-credential-socket\") pod \"04594b82-a635-4a8d-bde8-15e1194de40f\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970631 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-envoy\") pod \"04594b82-a635-4a8d-bde8-15e1194de40f\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970658 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-socket\") pod \"04594b82-a635-4a8d-bde8-15e1194de40f\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970702 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-data\") pod \"04594b82-a635-4a8d-bde8-15e1194de40f\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970771 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76rfn\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-kube-api-access-76rfn\") pod \"04594b82-a635-4a8d-bde8-15e1194de40f\" (UID: \"04594b82-a635-4a8d-bde8-15e1194de40f\") " Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970932 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04594b82-a635-4a8d-bde8-15e1194de40f" (UID: "04594b82-a635-4a8d-bde8-15e1194de40f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.970946 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04594b82-a635-4a8d-bde8-15e1194de40f" (UID: "04594b82-a635-4a8d-bde8-15e1194de40f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.971088 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.971109 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-credential-socket\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:34:51.971108 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.971106 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-data" (OuterVolumeSpecName: "istio-data") pod "04594b82-a635-4a8d-bde8-15e1194de40f" (UID: "04594b82-a635-4a8d-bde8-15e1194de40f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:34:51.971623 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.971164 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04594b82-a635-4a8d-bde8-15e1194de40f" (UID: "04594b82-a635-4a8d-bde8-15e1194de40f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:34:51.971623 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.971313 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04594b82-a635-4a8d-bde8-15e1194de40f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04594b82-a635-4a8d-bde8-15e1194de40f" (UID: "04594b82-a635-4a8d-bde8-15e1194de40f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:34:51.973000 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.972969 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04594b82-a635-4a8d-bde8-15e1194de40f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04594b82-a635-4a8d-bde8-15e1194de40f" (UID: "04594b82-a635-4a8d-bde8-15e1194de40f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 13 01:34:51.973000 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.972980 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04594b82-a635-4a8d-bde8-15e1194de40f" (UID: "04594b82-a635-4a8d-bde8-15e1194de40f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:34:51.973171 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.973109 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-istio-token" (OuterVolumeSpecName: "istio-token") pod "04594b82-a635-4a8d-bde8-15e1194de40f" (UID: "04594b82-a635-4a8d-bde8-15e1194de40f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:34:51.973206 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:51.973191 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-kube-api-access-76rfn" (OuterVolumeSpecName: "kube-api-access-76rfn") pod "04594b82-a635-4a8d-bde8-15e1194de40f" (UID: "04594b82-a635-4a8d-bde8-15e1194de40f"). InnerVolumeSpecName "kube-api-access-76rfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:34:52.072294 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.072266 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04594b82-a635-4a8d-bde8-15e1194de40f-istio-podinfo\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:34:52.072294 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.072294 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-envoy\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:34:52.072454 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.072306 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-workload-socket\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:34:52.072454 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.072318 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04594b82-a635-4a8d-bde8-15e1194de40f-istio-data\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:34:52.072454 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.072330 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76rfn\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-kube-api-access-76rfn\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:34:52.072454 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.072342 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04594b82-a635-4a8d-bde8-15e1194de40f-istiod-ca-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:34:52.072454 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.072354 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04594b82-a635-4a8d-bde8-15e1194de40f-istio-token\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:34:52.249435 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.249360 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:52.254116 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.254092 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:52.719248 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.719213 2563 generic.go:356] "Generic (PLEG): container finished" podID="04594b82-a635-4a8d-bde8-15e1194de40f" containerID="52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc" exitCode=0 Jun 13 01:34:52.719428 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.719258 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" Jun 13 01:34:52.719428 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.719302 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" event={"ID":"04594b82-a635-4a8d-bde8-15e1194de40f","Type":"ContainerDied","Data":"52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc"} Jun 13 01:34:52.719428 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.719348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn" event={"ID":"04594b82-a635-4a8d-bde8-15e1194de40f","Type":"ContainerDied","Data":"04e9ac25f7b6c5fb5c69d13e69b5e24255a2a72eb4d57957948b285b794fe3da"} Jun 13 01:34:52.719428 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.719372 2563 scope.go:117] "RemoveContainer" containerID="52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc" Jun 13 01:34:52.719757 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.719719 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:52.720848 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.720665 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:34:52.733428 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.733407 2563 scope.go:117] "RemoveContainer" containerID="52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc" Jun 13 01:34:52.733776 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:34:52.733750 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc\": container with ID starting with 52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc not found: ID does not exist" containerID="52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc" Jun 13 01:34:52.733861 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.733790 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc"} err="failed to get container status \"52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc\": rpc error: code = NotFound desc = could not find container \"52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc\": container with ID starting with 52b01891453acac5c5daf070075570b1ba33b11dfd243cce424ca8657e6bf5cc not found: ID does not exist" Jun 13 01:34:52.758603 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.758572 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn"] Jun 13 01:34:52.761955 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.761931 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c0f26516-openshift-default-74f9d8b9b-bjtrn"] Jun 13 01:34:52.842750 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:52.842706 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04594b82-a635-4a8d-bde8-15e1194de40f" path="/var/lib/kubelet/pods/04594b82-a635-4a8d-bde8-15e1194de40f/volumes" Jun 13 01:34:58.347696 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:58.347658 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c"] Jun 13 01:34:58.348124 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:34:58.347882 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" podUID="042104bb-5999-431d-b936-59016bfdae26" containerName="istio-proxy" containerID="cri-o://292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b" gracePeriod=30 Jun 13 01:35:03.586019 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.585994 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:35:03.673039 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.672936 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw2fg\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-kube-api-access-rw2fg\") pod \"042104bb-5999-431d-b936-59016bfdae26\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " Jun 13 01:35:03.673039 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673000 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042104bb-5999-431d-b936-59016bfdae26-istio-podinfo\") pod \"042104bb-5999-431d-b936-59016bfdae26\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " Jun 13 01:35:03.673262 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673045 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-socket\") pod \"042104bb-5999-431d-b936-59016bfdae26\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " Jun 13 01:35:03.673262 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673095 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042104bb-5999-431d-b936-59016bfdae26-istiod-ca-cert\") pod \"042104bb-5999-431d-b936-59016bfdae26\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " Jun 13 01:35:03.673262 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673128 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-data\") pod \"042104bb-5999-431d-b936-59016bfdae26\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " Jun 13 01:35:03.673262 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673221 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-certs\") pod \"042104bb-5999-431d-b936-59016bfdae26\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " Jun 13 01:35:03.673262 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673252 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-istio-token\") pod \"042104bb-5999-431d-b936-59016bfdae26\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " Jun 13 01:35:03.673502 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673284 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-credential-socket\") pod \"042104bb-5999-431d-b936-59016bfdae26\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " Jun 13 01:35:03.673502 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673325 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-envoy\") pod \"042104bb-5999-431d-b936-59016bfdae26\" (UID: \"042104bb-5999-431d-b936-59016bfdae26\") " Jun 13 01:35:03.673502 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673420 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "042104bb-5999-431d-b936-59016bfdae26" (UID: "042104bb-5999-431d-b936-59016bfdae26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:35:03.673665 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673523 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-data" (OuterVolumeSpecName: "istio-data") pod "042104bb-5999-431d-b936-59016bfdae26" (UID: "042104bb-5999-431d-b936-59016bfdae26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:35:03.673665 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673536 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "042104bb-5999-431d-b936-59016bfdae26" (UID: "042104bb-5999-431d-b936-59016bfdae26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:35:03.673665 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673567 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/042104bb-5999-431d-b936-59016bfdae26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "042104bb-5999-431d-b936-59016bfdae26" (UID: "042104bb-5999-431d-b936-59016bfdae26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:35:03.673854 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673709 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "042104bb-5999-431d-b936-59016bfdae26" (UID: "042104bb-5999-431d-b936-59016bfdae26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:35:03.673854 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673812 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042104bb-5999-431d-b936-59016bfdae26-istiod-ca-cert\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:35:03.673854 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673839 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-data\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:35:03.673854 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673852 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-certs\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:35:03.674019 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.673866 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-workload-socket\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:35:03.675349 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.675326 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-kube-api-access-rw2fg" (OuterVolumeSpecName: "kube-api-access-rw2fg") pod "042104bb-5999-431d-b936-59016bfdae26" (UID: "042104bb-5999-431d-b936-59016bfdae26"). InnerVolumeSpecName "kube-api-access-rw2fg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:35:03.675450 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.675429 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "042104bb-5999-431d-b936-59016bfdae26" (UID: "042104bb-5999-431d-b936-59016bfdae26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:35:03.675670 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.675653 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/042104bb-5999-431d-b936-59016bfdae26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "042104bb-5999-431d-b936-59016bfdae26" (UID: "042104bb-5999-431d-b936-59016bfdae26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 13 01:35:03.675730 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.675705 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-istio-token" (OuterVolumeSpecName: "istio-token") pod "042104bb-5999-431d-b936-59016bfdae26" (UID: "042104bb-5999-431d-b936-59016bfdae26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:35:03.770362 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.770328 2563 generic.go:356] "Generic (PLEG): container finished" podID="042104bb-5999-431d-b936-59016bfdae26" containerID="292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b" exitCode=0 Jun 13 01:35:03.770525 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.770374 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" Jun 13 01:35:03.770525 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.770419 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" event={"ID":"042104bb-5999-431d-b936-59016bfdae26","Type":"ContainerDied","Data":"292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b"} Jun 13 01:35:03.770525 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.770477 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c" event={"ID":"042104bb-5999-431d-b936-59016bfdae26","Type":"ContainerDied","Data":"6f48c1d281da2d17da9041efa550ebaa5478e12e0ca417246670ad2a5ddf0f86"} Jun 13 01:35:03.770525 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.770502 2563 scope.go:117] "RemoveContainer" containerID="292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b" Jun 13 01:35:03.778149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.777997 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042104bb-5999-431d-b936-59016bfdae26-istio-podinfo\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:35:03.778149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.778019 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-istio-token\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:35:03.778149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.778032 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-credential-socket\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:35:03.778149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.778047 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042104bb-5999-431d-b936-59016bfdae26-istio-envoy\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:35:03.778149 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.778064 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw2fg\" (UniqueName: \"kubernetes.io/projected/042104bb-5999-431d-b936-59016bfdae26-kube-api-access-rw2fg\") on node \"ip-10-0-129-95.ec2.internal\" DevicePath \"\"" Jun 13 01:35:03.785520 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.785503 2563 scope.go:117] "RemoveContainer" containerID="292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b" Jun 13 01:35:03.785768 ip-10-0-129-95 kubenswrapper[2563]: E0613 01:35:03.785731 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b\": container with ID starting with 292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b not found: ID does not exist" containerID="292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b" Jun 13 01:35:03.785821 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.785776 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b"} err="failed to get container status \"292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b\": rpc error: code = NotFound desc = could not find container \"292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b\": container with ID starting with 292a8c57871d2942777a7216d2299f7a0ad2a2c15ab85152e080dc3cd76d805b not found: ID does not exist" Jun 13 01:35:03.792719 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.792696 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c"] Jun 13 01:35:03.795985 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:03.795963 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9012b8f7-openshift-default-869954d47b-9fj8c"] Jun 13 01:35:04.843250 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:04.843216 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="042104bb-5999-431d-b936-59016bfdae26" path="/var/lib/kubelet/pods/042104bb-5999-431d-b936-59016bfdae26/volumes" Jun 13 01:35:10.373364 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:10.373326 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5647bc9dd-z4khl_4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc/authorino/0.log" Jun 13 01:35:15.240554 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:15.240510 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fb66499dd-k6vq8_47d319a5-2b07-4e93-929d-a79843b77293/maas-api/0.log" Jun 13 01:35:15.348399 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:15.348367 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688555-gcx4p_9878d8b3-f49e-485b-9091-d1ea46f191e4/cleanup/0.log" Jun 13 01:35:15.464134 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:15.464101 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688570-vmcxv_9565b696-a182-4423-8c74-1bcf98f584c4/cleanup/0.log" Jun 13 01:35:15.583128 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:15.583095 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b6b769cc9-hl5sb_3547b23c-0cb8-4373-8f3d-ffcd632fe1f4/manager/0.log" Jun 13 01:35:16.155303 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:16.155276 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78dd6f457b-rqgnd_9b811027-978e-4f34-a56a-7e4667278f42/copy-manifests/0.log" Jun 13 01:35:16.173331 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:16.173299 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78dd6f457b-rqgnd_9b811027-978e-4f34-a56a-7e4667278f42/manager/0.log" Jun 13 01:35:17.516839 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:17.516793 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5647bc9dd-z4khl_4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc/authorino/0.log" Jun 13 01:35:17.856365 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:17.856337 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9gm2j_8c3883b9-161d-404f-a82c-f946b0de78dd/kuadrant-console-plugin/0.log" Jun 13 01:35:18.222136 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:18.222057 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8hdlb_ecb11c42-21cf-4107-a07a-12ed78f30883/limitador/0.log" Jun 13 01:35:19.002573 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:19.002544 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4c88f8bb-nb9v4_6707c457-18d8-469f-85ce-84e2ca53f75e/kube-auth-proxy/0.log" Jun 13 01:35:24.569154 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.569118 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hv7p/must-gather-bx758"] Jun 13 01:35:24.569534 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.569470 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04594b82-a635-4a8d-bde8-15e1194de40f" containerName="istio-proxy" Jun 13 01:35:24.569534 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.569483 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="04594b82-a635-4a8d-bde8-15e1194de40f" containerName="istio-proxy" Jun 13 01:35:24.569534 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.569501 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="042104bb-5999-431d-b936-59016bfdae26" containerName="istio-proxy" Jun 13 01:35:24.569534 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.569507 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="042104bb-5999-431d-b936-59016bfdae26" containerName="istio-proxy" Jun 13 01:35:24.569671 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.569554 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="04594b82-a635-4a8d-bde8-15e1194de40f" containerName="istio-proxy" Jun 13 01:35:24.569671 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.569565 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="042104bb-5999-431d-b936-59016bfdae26" containerName="istio-proxy" Jun 13 01:35:24.580004 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.579967 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hv7p/must-gather-bx758"] Jun 13 01:35:24.580171 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.580101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hv7p/must-gather-bx758" Jun 13 01:35:24.582061 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.582036 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hv7p\"/\"openshift-service-ca.crt\"" Jun 13 01:35:24.582428 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.582411 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2hv7p\"/\"default-dockercfg-np42k\"" Jun 13 01:35:24.582526 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.582444 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hv7p\"/\"kube-root-ca.crt\"" Jun 13 01:35:24.768344 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.768292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9ac47d3d-1f85-40f4-8510-ce0014261cc4-must-gather-output\") pod \"must-gather-bx758\" (UID: \"9ac47d3d-1f85-40f4-8510-ce0014261cc4\") " pod="openshift-must-gather-2hv7p/must-gather-bx758" Jun 13 01:35:24.768344 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.768351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnn92\" (UniqueName: \"kubernetes.io/projected/9ac47d3d-1f85-40f4-8510-ce0014261cc4-kube-api-access-nnn92\") pod \"must-gather-bx758\" (UID: \"9ac47d3d-1f85-40f4-8510-ce0014261cc4\") " pod="openshift-must-gather-2hv7p/must-gather-bx758" Jun 13 01:35:24.869446 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.869347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9ac47d3d-1f85-40f4-8510-ce0014261cc4-must-gather-output\") pod \"must-gather-bx758\" (UID: \"9ac47d3d-1f85-40f4-8510-ce0014261cc4\") " pod="openshift-must-gather-2hv7p/must-gather-bx758" Jun 13 01:35:24.869446 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.869398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnn92\" (UniqueName: \"kubernetes.io/projected/9ac47d3d-1f85-40f4-8510-ce0014261cc4-kube-api-access-nnn92\") pod \"must-gather-bx758\" (UID: \"9ac47d3d-1f85-40f4-8510-ce0014261cc4\") " pod="openshift-must-gather-2hv7p/must-gather-bx758" Jun 13 01:35:24.869692 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.869675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9ac47d3d-1f85-40f4-8510-ce0014261cc4-must-gather-output\") pod \"must-gather-bx758\" (UID: \"9ac47d3d-1f85-40f4-8510-ce0014261cc4\") " pod="openshift-must-gather-2hv7p/must-gather-bx758" Jun 13 01:35:24.876777 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.876732 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnn92\" (UniqueName: \"kubernetes.io/projected/9ac47d3d-1f85-40f4-8510-ce0014261cc4-kube-api-access-nnn92\") pod \"must-gather-bx758\" (UID: \"9ac47d3d-1f85-40f4-8510-ce0014261cc4\") " pod="openshift-must-gather-2hv7p/must-gather-bx758" Jun 13 01:35:24.889518 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:24.889490 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hv7p/must-gather-bx758" Jun 13 01:35:25.018124 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:25.018103 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hv7p/must-gather-bx758"] Jun 13 01:35:25.020312 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:35:25.020284 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ac47d3d_1f85_40f4_8510_ce0014261cc4.slice/crio-0f6321abdebc29a3df85d00c372e023d0c3856118c610ef1e0b493e31375b5a7 WatchSource:0}: Error finding container 0f6321abdebc29a3df85d00c372e023d0c3856118c610ef1e0b493e31375b5a7: Status 404 returned error can't find the container with id 0f6321abdebc29a3df85d00c372e023d0c3856118c610ef1e0b493e31375b5a7 Jun 13 01:35:25.876414 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:25.876374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hv7p/must-gather-bx758" event={"ID":"9ac47d3d-1f85-40f4-8510-ce0014261cc4","Type":"ContainerStarted","Data":"9278c6b74de99b761fa25bc30fe63833e17ac5312d92831377f93e3e79edc392"} Jun 13 01:35:25.876915 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:25.876427 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hv7p/must-gather-bx758" event={"ID":"9ac47d3d-1f85-40f4-8510-ce0014261cc4","Type":"ContainerStarted","Data":"b6ab10661e0c15038c8e702c195f1ce9e2c3de76bd8b2c5f2f63edbe0e477df3"} Jun 13 01:35:25.876915 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:25.876444 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hv7p/must-gather-bx758" event={"ID":"9ac47d3d-1f85-40f4-8510-ce0014261cc4","Type":"ContainerStarted","Data":"0f6321abdebc29a3df85d00c372e023d0c3856118c610ef1e0b493e31375b5a7"} Jun 13 01:35:25.889330 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:25.889210 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hv7p/must-gather-bx758" podStartSLOduration=1.275881624 podStartE2EDuration="1.889189356s" totalImagesPullingTime="613.307732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:35:25.888686685 +0000 UTC m=+2355.450181147" watchObservedRunningTime="2026-06-13 01:35:25.889189356 +0000 UTC m=+2355.450683887" Jun 13 01:35:27.469326 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:27.469294 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z5vzw_0bd84a45-1f89-4332-b546-bbefc0576148/global-pull-secret-syncer/0.log" Jun 13 01:35:27.547266 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:27.547233 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-scnlj_a6663bd3-57e8-481d-b993-93839472ecbf/konnectivity-agent/0.log" Jun 13 01:35:27.595454 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:27.595423 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-95.ec2.internal_477309687a47d0ebc33e9d6215f4adc7/haproxy/0.log" Jun 13 01:35:32.834761 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:32.833361 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5647bc9dd-z4khl_4cd085b7-e37a-4dd7-9f1a-dcf0744b21dc/authorino/0.log" Jun 13 01:35:32.949213 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:32.949173 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9gm2j_8c3883b9-161d-404f-a82c-f946b0de78dd/kuadrant-console-plugin/0.log" Jun 13 01:35:33.079365 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:33.079340 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8hdlb_ecb11c42-21cf-4107-a07a-12ed78f30883/limitador/0.log" Jun 13 01:35:34.600193 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:34.600163 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54bae261-8e26-4134-8011-99116d497c06/alertmanager/0.log" Jun 13 01:35:34.624097 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:34.624070 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54bae261-8e26-4134-8011-99116d497c06/config-reloader/0.log" Jun 13 01:35:34.645948 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:34.645905 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54bae261-8e26-4134-8011-99116d497c06/kube-rbac-proxy-web/0.log" Jun 13 01:35:34.666391 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:34.666359 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54bae261-8e26-4134-8011-99116d497c06/kube-rbac-proxy/0.log" Jun 13 01:35:34.691374 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:34.691341 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54bae261-8e26-4134-8011-99116d497c06/kube-rbac-proxy-metric/0.log" Jun 13 01:35:34.712595 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:34.712564 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54bae261-8e26-4134-8011-99116d497c06/prom-label-proxy/0.log" Jun 13 01:35:34.735637 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:34.735605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54bae261-8e26-4134-8011-99116d497c06/init-config-reloader/0.log" Jun 13 01:35:34.945268 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:34.945182 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-28lbd_33b04eb2-96a0-4e7f-ba27-69da64783408/node-exporter/0.log" Jun 13 01:35:34.982640 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:34.982609 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-28lbd_33b04eb2-96a0-4e7f-ba27-69da64783408/kube-rbac-proxy/0.log" Jun 13 01:35:35.007764 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.007718 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-28lbd_33b04eb2-96a0-4e7f-ba27-69da64783408/init-textfile/0.log" Jun 13 01:35:35.550054 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.550023 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-4qs2b_52dd1544-2246-49a8-b58a-5f2750a0b7b3/prometheus-operator-admission-webhook/0.log" Jun 13 01:35:35.581537 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.581448 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74488b9889-lvx7z_beab5588-661b-462d-a966-5e604ee38eb2/telemeter-client/0.log" Jun 13 01:35:35.607010 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.606984 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74488b9889-lvx7z_beab5588-661b-462d-a966-5e604ee38eb2/reload/0.log" Jun 13 01:35:35.635889 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.635861 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74488b9889-lvx7z_beab5588-661b-462d-a966-5e604ee38eb2/kube-rbac-proxy/0.log" Jun 13 01:35:35.686552 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.686520 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58766b9554-dcgp6_fd773d75-25e9-4d63-82c8-1962a7c0fac2/thanos-query/0.log" Jun 13 01:35:35.714284 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.714259 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58766b9554-dcgp6_fd773d75-25e9-4d63-82c8-1962a7c0fac2/kube-rbac-proxy-web/0.log" Jun 13 01:35:35.738046 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.738013 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58766b9554-dcgp6_fd773d75-25e9-4d63-82c8-1962a7c0fac2/kube-rbac-proxy/0.log" Jun 13 01:35:35.763474 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.763442 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58766b9554-dcgp6_fd773d75-25e9-4d63-82c8-1962a7c0fac2/prom-label-proxy/0.log" Jun 13 01:35:35.796172 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.796134 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58766b9554-dcgp6_fd773d75-25e9-4d63-82c8-1962a7c0fac2/kube-rbac-proxy-rules/0.log" Jun 13 01:35:35.819157 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:35.819009 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58766b9554-dcgp6_fd773d75-25e9-4d63-82c8-1962a7c0fac2/kube-rbac-proxy-metrics/0.log" Jun 13 01:35:39.430066 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.430025 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs"] Jun 13 01:35:39.438480 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.438446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.447867 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.447841 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs"] Jun 13 01:35:39.528467 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.528410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-proc\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.528467 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.528469 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-podres\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.528718 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.528546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvmfs\" (UniqueName: \"kubernetes.io/projected/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-kube-api-access-tvmfs\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.528718 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.528590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-sys\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.528718 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.528684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-lib-modules\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.629437 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.629391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-lib-modules\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.629634 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.629493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-proc\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.629634 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.629521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-podres\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.629634 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.629570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvmfs\" (UniqueName: \"kubernetes.io/projected/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-kube-api-access-tvmfs\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.629634 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.629599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-sys\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.629634 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.629597 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-lib-modules\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.629919 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.629662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-proc\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.629919 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.629767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-sys\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.629919 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.629777 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-podres\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.636367 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.636322 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvmfs\" (UniqueName: \"kubernetes.io/projected/2e660a57-eeee-4dd4-a7e6-2fca66f632c6-kube-api-access-tvmfs\") pod \"perf-node-gather-daemonset-glmqs\" (UID: \"2e660a57-eeee-4dd4-a7e6-2fca66f632c6\") " pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.756038 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.755935 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:39.932986 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.932894 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs"] Jun 13 01:35:39.939267 ip-10-0-129-95 kubenswrapper[2563]: W0613 01:35:39.939221 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2e660a57_eeee_4dd4_a7e6_2fca66f632c6.slice/crio-c4e7df5e314e02ca49dc454c4901afe9f33dbb487cd75cf42bbdf9b9e88ec1d4 WatchSource:0}: Error finding container c4e7df5e314e02ca49dc454c4901afe9f33dbb487cd75cf42bbdf9b9e88ec1d4: Status 404 returned error can't find the container with id c4e7df5e314e02ca49dc454c4901afe9f33dbb487cd75cf42bbdf9b9e88ec1d4 Jun 13 01:35:39.987696 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:39.987660 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" event={"ID":"2e660a57-eeee-4dd4-a7e6-2fca66f632c6","Type":"ContainerStarted","Data":"c4e7df5e314e02ca49dc454c4901afe9f33dbb487cd75cf42bbdf9b9e88ec1d4"} Jun 13 01:35:40.360057 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:40.359982 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-scrkc_0dbf9ed9-980c-4b0e-8741-095d948b68ce/dns/0.log" Jun 13 01:35:40.381943 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:40.381907 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-scrkc_0dbf9ed9-980c-4b0e-8741-095d948b68ce/kube-rbac-proxy/0.log" Jun 13 01:35:40.447606 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:40.447575 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-84mtz_78d9b6a1-6e5e-4aea-8ca7-58f79c2faf65/dns-node-resolver/0.log" Jun 13 01:35:40.998294 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:40.998251 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" event={"ID":"2e660a57-eeee-4dd4-a7e6-2fca66f632c6","Type":"ContainerStarted","Data":"a898f7711fcff6ddd3aa6467de16481013d1b6729b1a91546949ab9c6d2b4783"} Jun 13 01:35:40.998457 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:40.998341 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:41.093329 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:41.093295 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zdvtn_d9ab10e4-4aee-4ed0-8fe2-918be94d1533/node-ca/0.log" Jun 13 01:35:42.128603 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:42.128572 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4c88f8bb-nb9v4_6707c457-18d8-469f-85ce-84e2ca53f75e/kube-auth-proxy/0.log" Jun 13 01:35:42.906532 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:42.906493 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vzmpn_9e17608a-fb6f-4b7d-acb3-fcdf4bab3ed7/serve-healthcheck-canary/0.log" Jun 13 01:35:43.569699 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:43.569669 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r4qfq_f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8/kube-rbac-proxy/0.log" Jun 13 01:35:43.589558 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:43.589527 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r4qfq_f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8/exporter/0.log" Jun 13 01:35:43.610169 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:43.610139 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r4qfq_f70b5b9e-17f4-4d6f-ae3e-6bf6e897bed8/extractor/0.log" Jun 13 01:35:45.916354 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:45.916324 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fb66499dd-k6vq8_47d319a5-2b07-4e93-929d-a79843b77293/maas-api/0.log" Jun 13 01:35:45.936896 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:45.936863 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688555-gcx4p_9878d8b3-f49e-485b-9091-d1ea46f191e4/cleanup/0.log" Jun 13 01:35:45.959639 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:45.959614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688570-vmcxv_9565b696-a182-4423-8c74-1bcf98f584c4/cleanup/0.log" Jun 13 01:35:46.086905 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:46.086878 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b6b769cc9-hl5sb_3547b23c-0cb8-4373-8f3d-ffcd632fe1f4/manager/0.log" Jun 13 01:35:46.404036 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:46.404001 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78dd6f457b-rqgnd_9b811027-978e-4f34-a56a-7e4667278f42/manager/0.log" Jun 13 01:35:46.422267 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:46.422242 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78dd6f457b-rqgnd_9b811027-978e-4f34-a56a-7e4667278f42/copy-manifests/0.log" Jun 13 01:35:47.017873 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:47.017838 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" Jun 13 01:35:47.033294 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:47.033233 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hv7p/perf-node-gather-daemonset-glmqs" podStartSLOduration=8.033210999 podStartE2EDuration="8.033210999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:35:41.011220456 +0000 UTC m=+2370.572714914" watchObservedRunningTime="2026-06-13 01:35:47.033210999 +0000 UTC m=+2376.594705457" Jun 13 01:35:48.039157 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:48.039082 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6dc4584f75-gqct7_c004ea14-7856-4e69-bef8-a7df9d5594d3/manager/0.log" Jun 13 01:35:53.118040 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:53.117993 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4c88f8bb-nb9v4_6707c457-18d8-469f-85ce-84e2ca53f75e/kube-auth-proxy/0.log" Jun 13 01:35:53.420407 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:53.420322 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-vfq77_564d7fe6-38f1-439d-b876-1935870bd7e4/migrator/0.log" Jun 13 01:35:53.441577 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:53.441550 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-vfq77_564d7fe6-38f1-439d-b876-1935870bd7e4/graceful-termination/0.log" Jun 13 01:35:54.464585 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:54.464536 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4c88f8bb-nb9v4_6707c457-18d8-469f-85ce-84e2ca53f75e/kube-auth-proxy/0.log" Jun 13 01:35:55.016694 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.016667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvn5g_f8b60e61-3e20-4f03-9dfe-995005d3f54e/kube-multus-additional-cni-plugins/0.log" Jun 13 01:35:55.037042 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.037010 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvn5g_f8b60e61-3e20-4f03-9dfe-995005d3f54e/egress-router-binary-copy/0.log" Jun 13 01:35:55.057309 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.057270 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvn5g_f8b60e61-3e20-4f03-9dfe-995005d3f54e/cni-plugins/0.log" Jun 13 01:35:55.077130 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.077103 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvn5g_f8b60e61-3e20-4f03-9dfe-995005d3f54e/bond-cni-plugin/0.log" Jun 13 01:35:55.099536 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.099504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvn5g_f8b60e61-3e20-4f03-9dfe-995005d3f54e/routeoverride-cni/0.log" Jun 13 01:35:55.120240 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.120208 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvn5g_f8b60e61-3e20-4f03-9dfe-995005d3f54e/whereabouts-cni-bincopy/0.log" Jun 13 01:35:55.143230 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.143204 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dvn5g_f8b60e61-3e20-4f03-9dfe-995005d3f54e/whereabouts-cni/0.log" Jun 13 01:35:55.630906 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.630853 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tpzrx_775918d5-1c6e-4393-91b2-6af86d7e1800/kube-multus/0.log" Jun 13 01:35:55.752067 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.752033 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mwctw_0b453c90-0c91-4ff6-ad96-12871a0d8224/network-metrics-daemon/0.log" Jun 13 01:35:55.772118 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:55.772086 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mwctw_0b453c90-0c91-4ff6-ad96-12871a0d8224/kube-rbac-proxy/0.log" Jun 13 01:35:56.250045 ip-10-0-129-95 kubenswrapper[2563]: I0613 01:35:56.249957 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4c88f8bb-nb9v4_6707c457-18d8-469f-85ce-84e2ca53f75e/kube-auth-proxy/0.log"